Skip to content

perf(fastlanes): fuse bit-packed compare into a transposed mask + untranspose#8239

Open
joseph-isaacs wants to merge 15 commits into
developfrom
claude/confident-hamilton-mZIEo
Open

perf(fastlanes): fuse bit-packed compare into a transposed mask + untranspose#8239
joseph-isaacs wants to merge 15 commits into
developfrom
claude/confident-hamilton-mZIEo

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

@joseph-isaacs joseph-isaacs commented Jun 3, 2026 •
edited
Loading

Summary

Replaces the unpack-then-compare streaming kernel for compare-against-constant with the FastLanes fused unpack_cmp:

  • compare each value as it is unpacked, accumulating results straight into a transposed 1024-bit mask ([u64; 16], one register-resident word per lane — no [bool; 1024]/[T; 1024] scratch),
  • a single SIMD untranspose_bits per block rotates the mask into logical row order, copied directly into the output bit buffer,
  • inline patches are spliced in afterwards; sliced (offset != 0) arrays fall back to the scalar streaming predicate.

@claude
bench: sweep bit-packed compare across all int types and bit widths
10939a6 
Add `bitpack_compare_sweep`, which exercises the public `array.binary(rhs,
op)` compare-against-constant path over all eight integer types and every
valid bit width (64Ki in-range elements per case, no patches). It isolates
the `<BitPacked as CompareKernel>` unpack + per-element compare kernel so a
kernel change shows up as a CodSpeed diff.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Jun 3, 2026 — with Claude
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Jun 3, 2026 •
edited
Loading

Merging this PR will improve performance by 59.63%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 239 improved benchmarks
✅ 1268 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation compare[1] 170.6 µs 58.5 µs ×2.9
⚡ Simulation compare[2] 171.9 µs 59.7 µs ×2.9
⚡ Simulation compare[1] 172.8 µs 60.2 µs ×2.9
⚡ Simulation compare[1] 163.3 µs 57.2 µs ×2.9
⚡ Simulation compare[1] 165.9 µs 58.7 µs ×2.8
⚡ Simulation compare[2] 165 µs 58.9 µs ×2.8
⚡ Simulation compare[2] 167.8 µs 60.5 µs ×2.8
⚡ Simulation compare[2] 176.3 µs 63.8 µs ×2.8
⚡ Simulation compare[3] 178.6 µs 66.8 µs ×2.7
⚡ Simulation compare[3] 180.7 µs 68.2 µs ×2.7
⚡ Simulation compare[3] 171.7 µs 65.5 µs ×2.6
⚡ Simulation compare[4] 181.6 µs 69.3 µs ×2.6
⚡ Simulation compare[3] 174.1 µs 66.9 µs ×2.6
⚡ Simulation compare[4] 183.9 µs 71.3 µs ×2.6
⚡ Simulation compare[4] 174.6 µs 68.5 µs ×2.5
⚡ Simulation compare[4] 177.2 µs 69.9 µs ×2.5
⚡ Simulation compare[5] 187.1 µs 75.2 µs ×2.5
⚡ Simulation compare[5] 188.9 µs 76.2 µs ×2.5
⚡ Simulation compare[5] 182.2 µs 74.9 µs ×2.4
⚡ Simulation compare[6] 190.9 µs 78.6 µs ×2.4
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.

Comparing claude/confident-hamilton-mZIEo (bd3fbaa) with develop (583b003)

Open in CodSpeed

@claude
perf(fastlanes): fuse bit-packed compare into a transposed mask + unt…
48da899 
…ranspose

Replace the unpack-then-compare streaming kernel for compare-against-constant
with the FastLanes fused `unpack_cmp`: compare each value as it is unpacked,
accumulating results straight into a transposed 1024-bit mask (`[u64; 16]`,
one register-resident word per lane - no `[bool; 1024]`/`[T; 1024]` scratch),
then a single SIMD `untranspose_bits` per block rotates the mask into logical
row order, copied directly into the output bit buffer. Inline patches are
spliced in afterwards; sliced (offset != 0) arrays fall back to the scalar
streaming predicate.

This requires the in-development FastLanes (PR #141 fused mask + PR #145
width-generic BMI2/VBMI untranspose), pinned via a git patch until released.

Benchmarked end-to-end through the public compare path (`bitpack_compare_sweep`,
64Ki elements, all integer types and bit widths): fused beats the streaming
baseline for every type and width -

  i8/u8   ~6.2-7.7x
  i16/u16 ~4.5-6.0x
  i32/u32 ~1.9-4.3x
  i64/u64 ~1.2-1.9x

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs force-pushed the claude/confident-hamilton-mZIEo branch from e27f5f4 to 48da899 Compare June 3, 2026 17:00
Base automatically changed from claude/confident-hamilton-mZIEo-benches to develop June 4, 2026 10:07
joseph-isaacs
joseph-isaacs commented Jun 4, 2026
View reviewed changes
Comment thread Cargo.toml Outdated
@joseph-isaacs joseph-isaacs added the do not merge Pull requests that are not intended to merge label Jun 4, 2026
claude and others added 3 commits June 4, 2026 10:31
@claude
ci(wasm): pin in-development FastLanes in the excluded wasm-test work…
08ed4a4 
…space

wasm-test is excluded from the workspace, so it does not inherit the root
[patch.crates-io] and was building vortex-fastlanes against published fastlanes
0.5.0 (old `[bool;1024]` unpack_cmp, no `untranspose_bits`) -> compile error in
compare_fused.rs. Add the matching git `rev` pin here. Temporary, like the root
pin: both are removed when a FastLanes release is cut and the version is bumped.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
wip
816032b 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
wip
e4dd660 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs removed the do not merge Pull requests that are not intended to merge label Jun 4, 2026
@joseph-isaacs
wip
933ca0e 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
wip
211903c 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
wip
0649f03 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
wip
83c90b9 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 4, 2026
@joseph-isaacs joseph-isaacs requested a review from robert3005 June 4, 2026 15:13
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 4, 2026
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) June 4, 2026 15:13
@joseph-isaacs
wip
4d50ff1 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 4, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 4, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 4d50ff1 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.959x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.959x ➖, 1↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 114183722 116777199 0.98
polarsignals_q01/datafusion:vortex-file-compressed 261971317 290257895 0.90
polarsignals_q02/datafusion:vortex-file-compressed 🚀 21568859 24183965 0.89
polarsignals_q03/datafusion:vortex-file-compressed 279115215 261437480 1.07
polarsignals_q04/datafusion:vortex-file-compressed 9633743 9642382 1.00
polarsignals_q05/datafusion:vortex-file-compressed 14177750 15223995 0.93
polarsignals_q06/datafusion:vortex-file-compressed 17719840 18579294 0.95
polarsignals_q07/datafusion:vortex-file-compressed 12580453 13480800 0.93
polarsignals_q08/datafusion:vortex-file-compressed 407340813 406340661 1.00
polarsignals_q09/datafusion:vortex-file-compressed 11646085 12380836 0.94

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.4%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (-2.8%, low confidence)
Vortex (geomean): 0.986x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.003x ➖, 0↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 4984893 5528854 0.90
fineweb_q01/datafusion:vortex-file-compressed 🚨 35570353 32035468 1.11
fineweb_q02/datafusion:vortex-file-compressed 35998049 39170321 0.92
fineweb_q03/datafusion:vortex-file-compressed 61302903 60845462 1.01
fineweb_q04/datafusion:vortex-file-compressed 275665860 276243377 1.00
fineweb_q05/datafusion:vortex-file-compressed 221048688 219041152 1.01
fineweb_q06/datafusion:vortex-file-compressed 52117237 49694923 1.05
fineweb_q07/datafusion:vortex-file-compressed 54396777 54829611 0.99
fineweb_q08/datafusion:vortex-file-compressed 23259804 22046653 1.06
datafusion / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5407558 5777413 0.94
fineweb_q01/datafusion:vortex-compact 97995637 99487066 0.99
fineweb_q02/datafusion:vortex-compact 103831338 103188661 1.01
fineweb_q03/datafusion:vortex-compact 861904352 871110138 0.99
fineweb_q04/datafusion:vortex-compact 916940917 915672922 1.00
fineweb_q05/datafusion:vortex-compact 832152364 833545136 1.00
fineweb_q06/datafusion:vortex-compact 468855265 465431525 1.01
fineweb_q07/datafusion:vortex-compact 484701072 483710346 1.00
fineweb_q08/datafusion:vortex-compact 19935968 20199603 0.99
datafusion / parquet (0.997x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6590024 6704475 0.98
fineweb_q01/datafusion:parquet 282235536 291785773 0.97
fineweb_q02/datafusion:parquet 296472309 302348400 0.98
fineweb_q03/datafusion:parquet 297635916 280047684 1.06
fineweb_q04/datafusion:parquet 308324942 304884355 1.01
fineweb_q05/datafusion:parquet 296399273 309747343 0.96
fineweb_q06/datafusion:parquet 285273393 290284989 0.98
fineweb_q07/datafusion:parquet 287082817 279242022 1.03
fineweb_q08/datafusion:parquet 276950911 276844294 1.00
duckdb / vortex-file-compressed (0.976x ➖, 1↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 4240459 4073870 1.04
fineweb_q01/duckdb:vortex-file-compressed 32852914 32059673 1.02
fineweb_q02/duckdb:vortex-file-compressed 36700760 39820407 0.92
fineweb_q03/duckdb:vortex-file-compressed 🚀 114000330 129685904 0.88
fineweb_q04/duckdb:vortex-file-compressed 271950881 267614443 1.02
fineweb_q05/duckdb:vortex-file-compressed 213762916 215981602 0.99
fineweb_q06/duckdb:vortex-file-compressed 49904589 51391693 0.97
fineweb_q07/duckdb:vortex-file-compressed 53109613 53170373 1.00
fineweb_q08/duckdb:vortex-file-compressed 21416783 22504704 0.95
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4035508 4224555 0.96
fineweb_q01/duckdb:vortex-compact 108338728 117690060 0.92
fineweb_q02/duckdb:vortex-compact 112804743 115491357 0.98
fineweb_q03/duckdb:vortex-compact 844653505 868703092 0.97
fineweb_q04/duckdb:vortex-compact 895224509 897446411 1.00
fineweb_q05/duckdb:vortex-compact 803209233 804237620 1.00
fineweb_q06/duckdb:vortex-compact 464127404 466470288 0.99
fineweb_q07/duckdb:vortex-compact 478970018 485726670 0.99
fineweb_q08/duckdb:vortex-compact 19649631 20054457 0.98
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31961273 30365336 1.05
fineweb_q01/duckdb:parquet 83538935 86062153 0.97
fineweb_q02/duckdb:parquet 84685367 84935173 1.00
fineweb_q03/duckdb:parquet 318044407 316182946 1.01
fineweb_q04/duckdb:parquet 445918627 445129454 1.00
fineweb_q05/duckdb:parquet 416027992 415216844 1.00
fineweb_q06/duckdb:parquet 204177742 203148455 1.01
fineweb_q07/duckdb:parquet 215364596 216515629 0.99
fineweb_q08/duckdb:parquet 32591324 32365037 1.01
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 130.10 KB -0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+1.4%, environment too noisy confidence) · DuckDB No clear signal (-0.8%, environment too noisy confidence)
Vortex (geomean): 1.003x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.007x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49733107 48075207 1.03
tpch_q02/datafusion:vortex-file-compressed 22573008 23226117 0.97
tpch_q03/datafusion:vortex-file-compressed 25398759 25773437 0.99
tpch_q04/datafusion:vortex-file-compressed 19674834 19237060 1.02
tpch_q05/datafusion:vortex-file-compressed 49104409 47138024 1.04
tpch_q06/datafusion:vortex-file-compressed 9735043 9066724 1.07
tpch_q07/datafusion:vortex-file-compressed 54241511 54236779 1.00
tpch_q08/datafusion:vortex-file-compressed 39219393 39785227 0.99
tpch_q09/datafusion:vortex-file-compressed 52024403 52142096 1.00
tpch_q10/datafusion:vortex-file-compressed 42548082 41168455 1.03
tpch_q11/datafusion:vortex-file-compressed 16059160 15759159 1.02
tpch_q12/datafusion:vortex-file-compressed 22746779 22660226 1.00
tpch_q13/datafusion:vortex-file-compressed 26745102 26887984 0.99
tpch_q14/datafusion:vortex-file-compressed 15271345 14993154 1.02
tpch_q15/datafusion:vortex-file-compressed 23070103 21704257 1.06
tpch_q16/datafusion:vortex-file-compressed 19353377 19956990 0.97
tpch_q17/datafusion:vortex-file-compressed 68888599 64924853 1.06
tpch_q18/datafusion:vortex-file-compressed 81295862 80618181 1.01
tpch_q19/datafusion:vortex-file-compressed 16624472 17937389 0.93
tpch_q20/datafusion:vortex-file-compressed 28678907 29745504 0.96
tpch_q21/datafusion:vortex-file-compressed 68933210 69671461 0.99
tpch_q22/datafusion:vortex-file-compressed 11076350 11093080 1.00
datafusion / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57363489 56347419 1.02
tpch_q02/datafusion:vortex-compact 25981184 25471878 1.02
tpch_q03/datafusion:vortex-compact 27198435 28082506 0.97
tpch_q04/datafusion:vortex-compact 21366418 21139126 1.01
tpch_q05/datafusion:vortex-compact 50000679 49445581 1.01
tpch_q06/datafusion:vortex-compact 11664069 11519271 1.01
tpch_q07/datafusion:vortex-compact 57715782 57406951 1.01
tpch_q08/datafusion:vortex-compact 41866448 42362556 0.99
tpch_q09/datafusion:vortex-compact 54262814 54479750 1.00
tpch_q10/datafusion:vortex-compact 43856426 43766007 1.00
tpch_q11/datafusion:vortex-compact 16780699 16948241 0.99
tpch_q12/datafusion:vortex-compact 28873946 28647462 1.01
tpch_q13/datafusion:vortex-compact 31791518 31981856 0.99
tpch_q14/datafusion:vortex-compact 18247027 17935077 1.02
tpch_q15/datafusion:vortex-compact 29663831 29412699 1.01
tpch_q16/datafusion:vortex-compact 23950079 23747456 1.01
tpch_q17/datafusion:vortex-compact 66024708 71113897 0.93
tpch_q18/datafusion:vortex-compact 82631300 82023575 1.01
tpch_q19/datafusion:vortex-compact 28631992 26586883 1.08
tpch_q20/datafusion:vortex-compact 33556412 32659765 1.03
tpch_q21/datafusion:vortex-compact 73034591 72743814 1.00
tpch_q22/datafusion:vortex-compact 12588265 12087758 1.04
datafusion / parquet (0.994x ➖, 1↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 94590698 131348135 0.72
tpch_q02/datafusion:parquet 61377602 62040018 0.99
tpch_q03/datafusion:parquet 71890057 72347035 0.99
tpch_q04/datafusion:parquet 44018958 42993765 1.02
tpch_q05/datafusion:parquet 92071452 92952542 0.99
tpch_q06/datafusion:parquet 41716369 41374768 1.01
tpch_q07/datafusion:parquet 106232284 103560392 1.03
tpch_q08/datafusion:parquet 96407199 94731755 1.02
tpch_q09/datafusion:parquet 130364334 129872501 1.00
tpch_q10/datafusion:parquet 111656962 111994222 1.00
tpch_q11/datafusion:parquet 41218648 40274761 1.02
tpch_q12/datafusion:parquet 88668458 83610348 1.06
tpch_q13/datafusion:parquet 200962531 197410412 1.02
tpch_q14/datafusion:parquet 46534944 47980038 0.97
tpch_q15/datafusion:parquet 58150718 56215592 1.03
tpch_q16/datafusion:parquet 40997637 41769127 0.98
tpch_q17/datafusion:parquet 125958730 126531741 1.00
tpch_q18/datafusion:parquet 166776357 161180762 1.03
tpch_q19/datafusion:parquet 🚨 80352067 68986265 1.16
tpch_q20/datafusion:parquet 67551853 68247964 0.99
tpch_q21/datafusion:parquet 128949041 133314955 0.97
tpch_q22/datafusion:parquet 31104541 33920156 0.92
datafusion / arrow (1.010x ➖, 0↑ 3↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 58563358 50509085 1.16
tpch_q02/datafusion:arrow 18529712 19559885 0.95
tpch_q03/datafusion:arrow 29476620 29832946 0.99
tpch_q04/datafusion:arrow 26027165 24653522 1.06
tpch_q05/datafusion:arrow 🚨 81406822 73063593 1.11
tpch_q06/datafusion:arrow 🚨 21997364 19572349 1.12
tpch_q07/datafusion:arrow 99982856 104208193 0.96
tpch_q08/datafusion:arrow 40408937 40814558 0.99
tpch_q09/datafusion:arrow 62226739 65826881 0.95
tpch_q10/datafusion:arrow 45842177 48073329 0.95
tpch_q11/datafusion:arrow 9169269 10063144 0.91
tpch_q12/datafusion:arrow 51700542 50778308 1.02
tpch_q13/datafusion:arrow 46962553 47850034 0.98
tpch_q14/datafusion:arrow 21214689 20678697 1.03
tpch_q15/datafusion:arrow 41118706 41279161 1.00
tpch_q16/datafusion:arrow 19189476 18745788 1.02
tpch_q17/datafusion:arrow 67904486 66392530 1.02
tpch_q18/datafusion:arrow 134603934 136557859 0.99
tpch_q19/datafusion:arrow 34676508 34259518 1.01
tpch_q20/datafusion:arrow 33826732 33380684 1.01
tpch_q21/datafusion:arrow 154382515 149369732 1.03
tpch_q22/datafusion:arrow 17562211 17588781 1.00
duckdb / vortex-file-compressed (1.003x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31255902 31135476 1.00
tpch_q02/duckdb:vortex-file-compressed 24522843 25121549 0.98
tpch_q03/duckdb:vortex-file-compressed 31898744 32257477 0.99
tpch_q04/duckdb:vortex-file-compressed 28420913 28636992 0.99
tpch_q05/duckdb:vortex-file-compressed 36209795 36543792 0.99
tpch_q06/duckdb:vortex-file-compressed 8402467 8378199 1.00
tpch_q07/duckdb:vortex-file-compressed 34097405 34699200 0.98
tpch_q08/duckdb:vortex-file-compressed 36785143 36844097 1.00
tpch_q09/duckdb:vortex-file-compressed 58485795 57110281 1.02
tpch_q10/duckdb:vortex-file-compressed 40683348 40272980 1.01
tpch_q11/duckdb:vortex-file-compressed 14906997 14181358 1.05
tpch_q12/duckdb:vortex-file-compressed 22103507 21532844 1.03
tpch_q13/duckdb:vortex-file-compressed 41505787 40937915 1.01
tpch_q14/duckdb:vortex-file-compressed 21793613 21396553 1.02
tpch_q15/duckdb:vortex-file-compressed 17309739 17024540 1.02
tpch_q16/duckdb:vortex-file-compressed 29942642 29452184 1.02
tpch_q17/duckdb:vortex-file-compressed 23238825 23918495 0.97
tpch_q18/duckdb:vortex-file-compressed 52016706 53235058 0.98
tpch_q19/duckdb:vortex-file-compressed 29044727 28840295 1.01
tpch_q20/duckdb:vortex-file-compressed 32237361 32213487 1.00
tpch_q21/duckdb:vortex-file-compressed 99475162 99444798 1.00
tpch_q22/duckdb:vortex-file-compressed 17015048 17034177 1.00
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38130436 38813622 0.98
tpch_q02/duckdb:vortex-compact 32661267 33479091 0.98
tpch_q03/duckdb:vortex-compact 34444044 33635303 1.02
tpch_q04/duckdb:vortex-compact 31276739 31590813 0.99
tpch_q05/duckdb:vortex-compact 40295264 40740142 0.99
tpch_q06/duckdb:vortex-compact 11320967 11479652 0.99
tpch_q07/duckdb:vortex-compact 40745929 40086261 1.02
tpch_q08/duckdb:vortex-compact 41799806 40588847 1.03
tpch_q09/duckdb:vortex-compact 64187827 64666398 0.99
tpch_q10/duckdb:vortex-compact 45488940 47564807 0.96
tpch_q11/duckdb:vortex-compact 18570867 18333029 1.01
tpch_q12/duckdb:vortex-compact 29415619 29045618 1.01
tpch_q13/duckdb:vortex-compact 47117662 46559008 1.01
tpch_q14/duckdb:vortex-compact 25526291 26585971 0.96
tpch_q15/duckdb:vortex-compact 19926498 19865268 1.00
tpch_q16/duckdb:vortex-compact 31431208 32704784 0.96
tpch_q17/duckdb:vortex-compact 29393283 28873933 1.02
tpch_q18/duckdb:vortex-compact 53640559 52716847 1.02
tpch_q19/duckdb:vortex-compact 33214469 33041596 1.01
tpch_q20/duckdb:vortex-compact 39095869 40168065 0.97
tpch_q21/duckdb:vortex-compact 103995360 102330489 1.02
tpch_q22/duckdb:vortex-compact 18267673 17958509 1.02
duckdb / parquet (1.009x ➖, 1↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77926728 77438734 1.01
tpch_q02/duckdb:parquet 39246720 39131744 1.00
tpch_q03/duckdb:parquet 70426750 70645559 1.00
tpch_q04/duckdb:parquet 53648791 52920142 1.01
tpch_q05/duckdb:parquet 74972788 68626866 1.09
tpch_q06/duckdb:parquet 22456848 22176882 1.01
tpch_q07/duckdb:parquet 🚨 83192201 69105502 1.20
tpch_q08/duckdb:parquet 83348943 82139051 1.01
tpch_q09/duckdb:parquet 134147921 138759612 0.97
tpch_q10/duckdb:parquet 128006905 138093244 0.93
tpch_q11/duckdb:parquet 22331201 22311724 1.00
tpch_q12/duckdb:parquet 🚀 46649951 56401971 0.83
tpch_q13/duckdb:parquet 251082674 249471995 1.01
tpch_q14/duckdb:parquet 51913013 50291367 1.03
tpch_q15/duckdb:parquet 31432652 29912356 1.05
tpch_q16/duckdb:parquet 57616155 58205777 0.99
tpch_q17/duckdb:parquet 59879838 58989749 1.02
tpch_q18/duckdb:parquet 119065689 118770348 1.00
tpch_q19/duckdb:parquet 70580265 69036813 1.02
tpch_q20/duckdb:parquet 66058232 65371157 1.01
tpch_q21/duckdb:parquet 182709648 175350015 1.04
tpch_q22/duckdb:parquet 54032782 54100615 1.00
duckdb / duckdb (1.000x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17776594 17545204 1.01
tpch_q02/duckdb:duckdb 14372598 14375781 1.00
tpch_q03/duckdb:duckdb 22006081 22352579 0.98
tpch_q04/duckdb:duckdb 22133304 22176155 1.00
tpch_q05/duckdb:duckdb 23341539 23131298 1.01
tpch_q06/duckdb:duckdb 7094594 7118511 1.00
tpch_q07/duckdb:duckdb 25437513 25182861 1.01
tpch_q08/duckdb:duckdb 24137326 24277096 0.99
tpch_q09/duckdb:duckdb 57848032 57939436 1.00
tpch_q10/duckdb:duckdb 50706417 50467712 1.00
tpch_q11/duckdb:duckdb 7131307 7071260 1.01
tpch_q12/duckdb:duckdb 18195877 18012834 1.01
tpch_q13/duckdb:duckdb 39609702 39623291 1.00
tpch_q14/duckdb:duckdb 21244141 21408438 0.99
tpch_q15/duckdb:duckdb 13567463 13559411 1.00
tpch_q16/duckdb:duckdb 25874060 26248142 0.99
tpch_q17/duckdb:duckdb 16056973 16282513 0.99
tpch_q18/duckdb:duckdb 40555486 40708775 1.00
tpch_q19/duckdb:duckdb 30663284 30425559 1.01
tpch_q20/duckdb:duckdb 25095279 25428358 0.99
tpch_q21/duckdb:duckdb 61840926 60884133 1.02
tpch_q22/duckdb:duckdb 25553381 25324916 1.01
File Size Changes (10 files changed, -0.1% overall, 4↑ 6↓)
File Scale Format Base HEAD Change %
part_0.vortex 1.0 vortex-compact 3.39 MB 3.50 MB +111.72 KB +3.2%
partsupp_0.vortex 1.0 vortex-compact 20.48 MB 20.64 MB +159.20 KB +0.8%
part_0.vortex 1.0 vortex-file-compressed 4.98 MB 5.01 MB +33.63 KB +0.7%
partsupp_0.vortex 1.0 vortex-file-compressed 23.80 MB 23.80 MB +2.03 KB +0.0%
customer_0.vortex 1.0 vortex-file-compressed 8.90 MB 8.90 MB 1.26 KB -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.66 MB 84.59 MB 77.04 KB -0.1%
orders_0.vortex 1.0 vortex-file-compressed 38.21 MB 38.14 MB 70.98 KB -0.2%
lineitem_0.vortex 1.0 vortex-file-compressed 85.20 MB 84.90 MB 310.31 KB -0.4%
orders_0.vortex 1.0 vortex-compact 32.20 MB 31.73 MB 482.27 KB -1.5%
supplier_0.vortex 1.0 vortex-file-compressed 614.52 KB 605.14 KB 9.38 KB -1.5%

Totals:

  • vortex-compact: 190.30 MB → 190.09 MB (-0.1%)
  • vortex-file-compressed: 246.64 MB → 246.22 MB (-0.2%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+1.4%, low confidence) · DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): 1.012x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.015x ➖, 1↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 25610814 24537480 1.04
tpcds_q02/datafusion:vortex-file-compressed 46356384 46079616 1.01
tpcds_q03/datafusion:vortex-file-compressed 14917467 14381112 1.04
tpcds_q04/datafusion:vortex-file-compressed 260611423 255757622 1.02
tpcds_q05/datafusion:vortex-file-compressed 43270343 42643463 1.01
tpcds_q06/datafusion:vortex-file-compressed 58507203 59537041 0.98
tpcds_q07/datafusion:vortex-file-compressed 43886062 41340478 1.06
tpcds_q08/datafusion:vortex-file-compressed 29568400 28050071 1.05
tpcds_q09/datafusion:vortex-file-compressed 36051440 37921398 0.95
tpcds_q10/datafusion:vortex-file-compressed 38513247 37219299 1.03
tpcds_q11/datafusion:vortex-file-compressed 135158558 127322584 1.06
tpcds_q12/datafusion:vortex-file-compressed 19625016 17945332 1.09
tpcds_q13/datafusion:vortex-file-compressed 47291790 44763942 1.06
tpcds_q14/datafusion:vortex-file-compressed 167848124 169344554 0.99
tpcds_q15/datafusion:vortex-file-compressed 27792048 28171849 0.99
tpcds_q16/datafusion:vortex-file-compressed 27730099 28091306 0.99
tpcds_q17/datafusion:vortex-file-compressed 62083598 61405693 1.01
tpcds_q18/datafusion:vortex-file-compressed 69032433 69607379 0.99
tpcds_q19/datafusion:vortex-file-compressed 22864511 22060163 1.04
tpcds_q20/datafusion:vortex-file-compressed 20570489 21145183 0.97
tpcds_q21/datafusion:vortex-file-compressed 36695148 35716897 1.03
tpcds_q22/datafusion:vortex-file-compressed 111173404 119890427 0.93
tpcds_q23/datafusion:vortex-file-compressed 150100515 149895204 1.00
tpcds_q24/datafusion:vortex-file-compressed 83625045 86158966 0.97
tpcds_q25/datafusion:vortex-file-compressed 66174323 65792902 1.01
tpcds_q26/datafusion:vortex-file-compressed 33677043 33690452 1.00
tpcds_q27/datafusion:vortex-file-compressed 111108305 101455494 1.10
tpcds_q28/datafusion:vortex-file-compressed 27964747 29802876 0.94
tpcds_q29/datafusion:vortex-file-compressed 61162808 60523410 1.01
tpcds_q30/datafusion:vortex-file-compressed 23235965 22575447 1.03
tpcds_q31/datafusion:vortex-file-compressed 73561081 71914735 1.02
tpcds_q32/datafusion:vortex-file-compressed 18962226 18556985 1.02
tpcds_q33/datafusion:vortex-file-compressed 30103843 29633997 1.02
tpcds_q34/datafusion:vortex-file-compressed 23879928 24226555 0.99
tpcds_q35/datafusion:vortex-file-compressed 43911308 43806909 1.00
tpcds_q36/datafusion:vortex-file-compressed 59904593 59197547 1.01
tpcds_q37/datafusion:vortex-file-compressed 24516739 23730105 1.03
tpcds_q38/datafusion:vortex-file-compressed 43007868 41557271 1.03
tpcds_q39/datafusion:vortex-file-compressed 111545835 104621408 1.07
tpcds_q40/datafusion:vortex-file-compressed 32966018 32723496 1.01
tpcds_q41/datafusion:vortex-file-compressed 15106863 14761986 1.02
tpcds_q42/datafusion:vortex-file-compressed 13640465 13365307 1.02
tpcds_q43/datafusion:vortex-file-compressed 18988681 18429939 1.03
tpcds_q44/datafusion:vortex-file-compressed 30746799 29453320 1.04
tpcds_q45/datafusion:vortex-file-compressed 28272990 27774894 1.02
tpcds_q46/datafusion:vortex-file-compressed 35204567 34649167 1.02
tpcds_q47/datafusion:vortex-file-compressed 135791687 132388744 1.03
tpcds_q48/datafusion:vortex-file-compressed 34322354 33371659 1.03
tpcds_q49/datafusion:vortex-file-compressed 58271145 56745406 1.03
tpcds_q50/datafusion:vortex-file-compressed 39513749 38863578 1.02
tpcds_q51/datafusion:vortex-file-compressed 88588079 86114088 1.03
tpcds_q52/datafusion:vortex-file-compressed 14099827 13551370 1.04
tpcds_q53/datafusion:vortex-file-compressed 21952864 21154826 1.04
tpcds_q54/datafusion:vortex-file-compressed 35231019 35703686 0.99
tpcds_q55/datafusion:vortex-file-compressed 14352920 13096934 1.10
tpcds_q56/datafusion:vortex-file-compressed 29260927 30327372 0.96
tpcds_q57/datafusion:vortex-file-compressed 105211008 106405695 0.99
tpcds_q58/datafusion:vortex-file-compressed 54218871 51117458 1.06
tpcds_q59/datafusion:vortex-file-compressed 55124370 55421385 0.99
tpcds_q60/datafusion:vortex-file-compressed 29454507 30301168 0.97
tpcds_q61/datafusion:vortex-file-compressed 39594737 39394503 1.01
tpcds_q62/datafusion:vortex-file-compressed 26991911 26088466 1.03
tpcds_q63/datafusion:vortex-file-compressed 21851305 21075656 1.04
tpcds_q64/datafusion:vortex-file-compressed 430309990 406765682 1.06
tpcds_q65/datafusion:vortex-file-compressed 38400180 39908135 0.96
tpcds_q66/datafusion:vortex-file-compressed 69935473 70049151 1.00
tpcds_q67/datafusion:vortex-file-compressed 147274747 150429573 0.98
tpcds_q68/datafusion:vortex-file-compressed 33721778 32737963 1.03
tpcds_q69/datafusion:vortex-file-compressed 36054009 33986872 1.06
tpcds_q70/datafusion:vortex-file-compressed 84236282 80804930 1.04
tpcds_q71/datafusion:vortex-file-compressed 22831636 22774408 1.00
tpcds_q72/datafusion:vortex-file-compressed 2216261435 2204329383 1.01
tpcds_q73/datafusion:vortex-file-compressed 22908747 22369207 1.02
tpcds_q74/datafusion:vortex-file-compressed 83972150 81046749 1.04
tpcds_q75/datafusion:vortex-file-compressed 107970741 106718572 1.01
tpcds_q76/datafusion:vortex-file-compressed 30771998 30798556 1.00
tpcds_q77/datafusion:vortex-file-compressed 42829827 39851799 1.07
tpcds_q78/datafusion:vortex-file-compressed 122930431 123413250 1.00
tpcds_q79/datafusion:vortex-file-compressed 29259958 28458889 1.03
tpcds_q80/datafusion:vortex-file-compressed 96553581 92240250 1.05
tpcds_q81/datafusion:vortex-file-compressed 24198805 24770969 0.98
tpcds_q82/datafusion:vortex-file-compressed 24138726 25110450 0.96
tpcds_q83/datafusion:vortex-file-compressed 33758135 33390634 1.01
tpcds_q84/datafusion:vortex-file-compressed 12861656 12400032 1.04
tpcds_q85/datafusion:vortex-file-compressed 89924332 90531990 0.99
tpcds_q86/datafusion:vortex-file-compressed 15470599 15637584 0.99
tpcds_q87/datafusion:vortex-file-compressed 43123330 43555498 0.99
tpcds_q88/datafusion:vortex-file-compressed 56130324 56809942 0.99
tpcds_q89/datafusion:vortex-file-compressed 25684079 24083071 1.07
tpcds_q90/datafusion:vortex-file-compressed 14103022 13727476 1.03
tpcds_q91/datafusion:vortex-file-compressed 18255388 18045485 1.01
tpcds_q92/datafusion:vortex-file-compressed 17732227 17499245 1.01
tpcds_q93/datafusion:vortex-file-compressed 33272648 33708796 0.99
tpcds_q94/datafusion:vortex-file-compressed 23048609 22739833 1.01
tpcds_q95/datafusion:vortex-file-compressed 60538267 60081316 1.01
tpcds_q96/datafusion:vortex-file-compressed 13954230 13027426 1.07
tpcds_q97/datafusion:vortex-file-compressed 31627278 30245099 1.05
tpcds_q98/datafusion:vortex-file-compressed 25399307 23734354 1.07
tpcds_q99/datafusion:vortex-file-compressed 🚀 27525806 33000863 0.83
datafusion / vortex-compact (1.012x ➖, 0↑ 3↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26254094 25780902 1.02
tpcds_q02/datafusion:vortex-compact 53473899 54134565 0.99
tpcds_q03/datafusion:vortex-compact 20048015 19854909 1.01
tpcds_q04/datafusion:vortex-compact 284412801 298530700 0.95
tpcds_q05/datafusion:vortex-compact 47774564 48486423 0.99
tpcds_q06/datafusion:vortex-compact 63750836 60586614 1.05
tpcds_q07/datafusion:vortex-compact 53346161 52665417 1.01
tpcds_q08/datafusion:vortex-compact 35456433 35529131 1.00
tpcds_q09/datafusion:vortex-compact 49798722 49560126 1.00
tpcds_q10/datafusion:vortex-compact 47618714 47694294 1.00
tpcds_q11/datafusion:vortex-compact 158744269 153439483 1.03
tpcds_q12/datafusion:vortex-compact 24326039 25537664 0.95
tpcds_q13/datafusion:vortex-compact 119371762 123215082 0.97
tpcds_q14/datafusion:vortex-compact 198801217 200447707 0.99
tpcds_q15/datafusion:vortex-compact 31062205 30286494 1.03
tpcds_q16/datafusion:vortex-compact 30934031 31193420 0.99
tpcds_q17/datafusion:vortex-compact 75432273 72895789 1.03
tpcds_q18/datafusion:vortex-compact 78445075 77362309 1.01
tpcds_q19/datafusion:vortex-compact 31152148 30149922 1.03
tpcds_q20/datafusion:vortex-compact 25468405 25367642 1.00
tpcds_q21/datafusion:vortex-compact 40983538 40368735 1.02
tpcds_q22/datafusion:vortex-compact 129355132 139200759 0.93
tpcds_q23/datafusion:vortex-compact 164437090 166791033 0.99
tpcds_q24/datafusion:vortex-compact 100291873 101453600 0.99
tpcds_q25/datafusion:vortex-compact 82065874 78707594 1.04
tpcds_q26/datafusion:vortex-compact 45649392 43136504 1.06
tpcds_q27/datafusion:vortex-compact 122715191 123943818 0.99
tpcds_q28/datafusion:vortex-compact 94471185 95104348 0.99
tpcds_q29/datafusion:vortex-compact 74883708 72792865 1.03
tpcds_q30/datafusion:vortex-compact 27981374 28734341 0.97
tpcds_q31/datafusion:vortex-compact 98318266 94715096 1.04
tpcds_q32/datafusion:vortex-compact 25207514 24592122 1.03
tpcds_q33/datafusion:vortex-compact 36877372 37300448 0.99
tpcds_q34/datafusion:vortex-compact 33954207 33338621 1.02
tpcds_q35/datafusion:vortex-compact 50796591 50819998 1.00
tpcds_q36/datafusion:vortex-compact 🚨 83677075 75618742 1.11
tpcds_q37/datafusion:vortex-compact 35372278 33137455 1.07
tpcds_q38/datafusion:vortex-compact 50632611 50614881 1.00
tpcds_q39/datafusion:vortex-compact 118275527 117505392 1.01
tpcds_q40/datafusion:vortex-compact 36175342 36677206 0.99
tpcds_q41/datafusion:vortex-compact 17176794 17580854 0.98
tpcds_q42/datafusion:vortex-compact 17960748 18492705 0.97
tpcds_q43/datafusion:vortex-compact 24911013 24568546 1.01
tpcds_q44/datafusion:vortex-compact 47303534 47457062 1.00
tpcds_q45/datafusion:vortex-compact 32212931 31924366 1.01
tpcds_q46/datafusion:vortex-compact 46373766 44515008 1.04
tpcds_q47/datafusion:vortex-compact 155017976 152482879 1.02
tpcds_q48/datafusion:vortex-compact 83197364 80302065 1.04
tpcds_q49/datafusion:vortex-compact 71526257 72725236 0.98
tpcds_q50/datafusion:vortex-compact 48647330 47250081 1.03
tpcds_q51/datafusion:vortex-compact 94117046 94570896 1.00
tpcds_q52/datafusion:vortex-compact 19027036 19565747 0.97
tpcds_q53/datafusion:vortex-compact 30888072 28409499 1.09
tpcds_q54/datafusion:vortex-compact 42274630 40938638 1.03
tpcds_q55/datafusion:vortex-compact 18595614 17341057 1.07
tpcds_q56/datafusion:vortex-compact 35816656 37550538 0.95
tpcds_q57/datafusion:vortex-compact 115084267 119379266 0.96
tpcds_q58/datafusion:vortex-compact 61643764 64310423 0.96
tpcds_q59/datafusion:vortex-compact 69317166 68219519 1.02
tpcds_q60/datafusion:vortex-compact 36464836 36778042 0.99
tpcds_q61/datafusion:vortex-compact 54884295 54040571 1.02
tpcds_q62/datafusion:vortex-compact 🚨 31493624 24198353 1.30
tpcds_q63/datafusion:vortex-compact 28177587 28329784 0.99
tpcds_q64/datafusion:vortex-compact 456034466 461116453 0.99
tpcds_q65/datafusion:vortex-compact 53201093 53955831 0.99
tpcds_q66/datafusion:vortex-compact 78262843 78341234 1.00
tpcds_q67/datafusion:vortex-compact 157602241 152656918 1.03
tpcds_q68/datafusion:vortex-compact 45385711 44809485 1.01
tpcds_q69/datafusion:vortex-compact 46799749 45126272 1.04
tpcds_q70/datafusion:vortex-compact 98912526 94996793 1.04
tpcds_q71/datafusion:vortex-compact 30311711 30237482 1.00
tpcds_q72/datafusion:vortex-compact 2232373210 2172199224 1.03
tpcds_q73/datafusion:vortex-compact 30503881 29827614 1.02
tpcds_q74/datafusion:vortex-compact 100662325 97650204 1.03
tpcds_q75/datafusion:vortex-compact 133970928 127316137 1.05
tpcds_q76/datafusion:vortex-compact 32797585 35493455 0.92
tpcds_q77/datafusion:vortex-compact 51198556 52327261 0.98
tpcds_q78/datafusion:vortex-compact 145216191 141641367 1.03
tpcds_q79/datafusion:vortex-compact 39159270 39368055 0.99
tpcds_q80/datafusion:vortex-compact 105996048 104240479 1.02
tpcds_q81/datafusion:vortex-compact 29606576 29663604 1.00
tpcds_q82/datafusion:vortex-compact 35182839 33337114 1.06
tpcds_q83/datafusion:vortex-compact 35185062 33327791 1.06
tpcds_q84/datafusion:vortex-compact 14496255 13861077 1.05
tpcds_q85/datafusion:vortex-compact 156797494 147154268 1.07
tpcds_q86/datafusion:vortex-compact 20060658 20180041 0.99
tpcds_q87/datafusion:vortex-compact 51244739 53208216 0.96
tpcds_q88/datafusion:vortex-compact 76161181 77132381 0.99
tpcds_q89/datafusion:vortex-compact 30535801 31183820 0.98
tpcds_q90/datafusion:vortex-compact 15018795 14676052 1.02
tpcds_q91/datafusion:vortex-compact 31250409 32573409 0.96
tpcds_q92/datafusion:vortex-compact 24961315 22957753 1.09
tpcds_q93/datafusion:vortex-compact 39462871 38599513 1.02
tpcds_q94/datafusion:vortex-compact 🚨 29127733 24731268 1.18
tpcds_q95/datafusion:vortex-compact 65248495 67253029 0.97
tpcds_q96/datafusion:vortex-compact 16833361 17309108 0.97
tpcds_q97/datafusion:vortex-compact 34471171 34834230 0.99
tpcds_q98/datafusion:vortex-compact 29785887 29839751 1.00
tpcds_q99/datafusion:vortex-compact 35717807 35834819 1.00
datafusion / parquet (0.999x ➖, 2↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 30842931 30483903 1.01
tpcds_q02/datafusion:parquet 41361684 43870750 0.94
tpcds_q03/datafusion:parquet 13347400 13309338 1.00
tpcds_q04/datafusion:parquet 268343794 275872907 0.97
tpcds_q05/datafusion:parquet 42781107 41662191 1.03
tpcds_q06/datafusion:parquet 59339172 58879122 1.01
tpcds_q07/datafusion:parquet 79780196 74372185 1.07
tpcds_q08/datafusion:parquet 28156946 26083945 1.08
tpcds_q09/datafusion:parquet 47059769 43305715 1.09
tpcds_q10/datafusion:parquet 72717371 66581015 1.09
tpcds_q11/datafusion:parquet 148943815 145790782 1.02
tpcds_q12/datafusion:parquet 16172998 16257960 0.99
tpcds_q13/datafusion:parquet 74645551 72476345 1.03
tpcds_q14/datafusion:parquet 162940921 160551828 1.01
tpcds_q15/datafusion:parquet 21171061 22262375 0.95
tpcds_q16/datafusion:parquet 23261059 23237221 1.00
tpcds_q17/datafusion:parquet 62955272 64315922 0.98
tpcds_q18/datafusion:parquet 113779455 114740489 0.99
tpcds_q19/datafusion:parquet 22564291 21938205 1.03
tpcds_q20/datafusion:parquet 16637799 16781336 0.99
tpcds_q21/datafusion:parquet 18896069 18981125 1.00
tpcds_q22/datafusion:parquet 150423045 149556296 1.01
tpcds_q23/datafusion:parquet 149451941 143894585 1.04
tpcds_q24/datafusion:parquet 90319994 93879733 0.96
tpcds_q25/datafusion:parquet 64016765 63277072 1.01
tpcds_q26/datafusion:parquet 63530939 64452972 0.99
tpcds_q27/datafusion:parquet 145006069 145124835 1.00
tpcds_q28/datafusion:parquet 44426115 45961247 0.97
tpcds_q29/datafusion:parquet 64978165 65438206 0.99
tpcds_q30/datafusion:parquet 34167896 33819393 1.01
tpcds_q31/datafusion:parquet 64774026 64789693 1.00
tpcds_q32/datafusion:parquet 17835623 18101531 0.99
tpcds_q33/datafusion:parquet 27077968 26672150 1.02
tpcds_q34/datafusion:parquet 22801064 25007379 0.91
tpcds_q35/datafusion:parquet 67131575 69859332 0.96
tpcds_q36/datafusion:parquet 56375993 56259391 1.00
tpcds_q37/datafusion:parquet 18793471 19075288 0.99
tpcds_q38/datafusion:parquet 41422355 43608692 0.95
tpcds_q39/datafusion:parquet 73441014 71784153 1.02
tpcds_q40/datafusion:parquet 26042519 23912231 1.09
tpcds_q41/datafusion:parquet 13502799 13016927 1.04
tpcds_q42/datafusion:parquet 🚨 12280073 11081657 1.11
tpcds_q43/datafusion:parquet 17001125 16989745 1.00
tpcds_q44/datafusion:parquet 34249562 34129929 1.00
tpcds_q45/datafusion:parquet 28775648 28613528 1.01
tpcds_q46/datafusion:parquet 32184827 31906116 1.01
tpcds_q47/datafusion:parquet 128067816 126911246 1.01
tpcds_q48/datafusion:parquet 70460633 68363042 1.03
tpcds_q49/datafusion:parquet 56215287 57381616 0.98
tpcds_q50/datafusion:parquet 45026744 43923051 1.03
tpcds_q51/datafusion:parquet 85492832 88026542 0.97
tpcds_q52/datafusion:parquet 11690030 11548024 1.01
tpcds_q53/datafusion:parquet 17348398 17395269 1.00
tpcds_q54/datafusion:parquet 33634836 34177752 0.98
tpcds_q55/datafusion:parquet 11038716 11161100 0.99
tpcds_q56/datafusion:parquet 26906665 26516535 1.01
tpcds_q57/datafusion:parquet 100108290 102498519 0.98
tpcds_q58/datafusion:parquet 50373122 49748752 1.01
tpcds_q59/datafusion:parquet 57723341 58336572 0.99
tpcds_q60/datafusion:parquet 28540330 27670996 1.03
tpcds_q61/datafusion:parquet 43763332 42711821 1.02
tpcds_q62/datafusion:parquet 🚀 20033659 24851974 0.81
tpcds_q63/datafusion:parquet 17345917 17846050 0.97
tpcds_q64/datafusion:parquet 517672583 507469568 1.02
tpcds_q65/datafusion:parquet 36415915 36862248 0.99
tpcds_q66/datafusion:parquet 65189576 69691587 0.94
tpcds_q67/datafusion:parquet 147556190 149023154 0.99
tpcds_q68/datafusion:parquet 31640035 31178972 1.01
tpcds_q69/datafusion:parquet 63525504 64294590 0.99
tpcds_q70/datafusion:parquet 86894787 89054827 0.98
tpcds_q71/datafusion:parquet 22674694 21905241 1.04
tpcds_q72/datafusion:parquet 621331261 608958829 1.02
tpcds_q73/datafusion:parquet 21004623 20337799 1.03
tpcds_q74/datafusion:parquet 90087959 82347440 1.09
tpcds_q75/datafusion:parquet 99075536 99712272 0.99
tpcds_q76/datafusion:parquet 29224795 29840654 0.98
tpcds_q77/datafusion:parquet 38901604 38651561 1.01
tpcds_q78/datafusion:parquet 115899435 112269454 1.03
tpcds_q79/datafusion:parquet 25653710 27607750 0.93
tpcds_q80/datafusion:parquet 80931828 83184344 0.97
tpcds_q81/datafusion:parquet 30853180 31037181 0.99
tpcds_q82/datafusion:parquet 19168075 18902935 1.01
tpcds_q83/datafusion:parquet 36174917 36385609 0.99
tpcds_q84/datafusion:parquet 38671270 38419552 1.01
tpcds_q85/datafusion:parquet 149795356 146430242 1.02
tpcds_q86/datafusion:parquet 14450594 14560025 0.99
tpcds_q87/datafusion:parquet 41759370 42674095 0.98
tpcds_q88/datafusion:parquet 61583903 59252792 1.04
tpcds_q89/datafusion:parquet 21108747 21391298 0.99
tpcds_q90/datafusion:parquet 13631084 14218324 0.96
tpcds_q91/datafusion:parquet 58783207 56762968 1.04
tpcds_q92/datafusion:parquet 17838300 18134556 0.98
tpcds_q93/datafusion:parquet 32296170 31610683 1.02
tpcds_q94/datafusion:parquet 19041769 20156347 0.94
tpcds_q95/datafusion:parquet 60572509 58933726 1.03
tpcds_q96/datafusion:parquet 11726856 11645219 1.01
tpcds_q97/datafusion:parquet 29616741 30596730 0.97
tpcds_q98/datafusion:parquet 21270090 21291861 1.00
tpcds_q99/datafusion:parquet 🚀 25912293 31185422 0.83
duckdb / vortex-file-compressed (1.014x ➖, 0↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24390537 22619942 1.08
tpcds_q02/duckdb:vortex-file-compressed 36370939 33623377 1.08
tpcds_q03/duckdb:vortex-file-compressed 15974408 17527300 0.91
tpcds_q04/duckdb:vortex-file-compressed 93832997 92740318 1.01
tpcds_q05/duckdb:vortex-file-compressed 31509664 31641186 1.00
tpcds_q06/duckdb:vortex-file-compressed 32500053 32798087 0.99
tpcds_q07/duckdb:vortex-file-compressed 20700167 21000342 0.99
tpcds_q08/duckdb:vortex-file-compressed 26975175 25874340 1.04
tpcds_q09/duckdb:vortex-file-compressed 16811608 16698896 1.01
tpcds_q10/duckdb:vortex-file-compressed 36901496 36220214 1.02
tpcds_q11/duckdb:vortex-file-compressed 63819946 64548498 0.99
tpcds_q12/duckdb:vortex-file-compressed 15304537 15166635 1.01
tpcds_q13/duckdb:vortex-file-compressed 32018303 31779128 1.01
tpcds_q14/duckdb:vortex-file-compressed 96837141 99377525 0.97
tpcds_q15/duckdb:vortex-file-compressed 26984204 26375150 1.02
tpcds_q16/duckdb:vortex-file-compressed 25209048 25445256 0.99
tpcds_q17/duckdb:vortex-file-compressed 43735916 44112258 0.99
tpcds_q18/duckdb:vortex-file-compressed 37136788 35420657 1.05
tpcds_q19/duckdb:vortex-file-compressed 31995668 30749175 1.04
tpcds_q20/duckdb:vortex-file-compressed 16876507 16373826 1.03
tpcds_q21/duckdb:vortex-file-compressed 15900543 15725012 1.01
tpcds_q22/duckdb:vortex-file-compressed 74641679 74319266 1.00
tpcds_q23/duckdb:vortex-file-compressed 96390821 95497086 1.01
tpcds_q24/duckdb:vortex-file-compressed 46698547 46251671 1.01
tpcds_q25/duckdb:vortex-file-compressed 40715567 40703699 1.00
tpcds_q26/duckdb:vortex-file-compressed 19654431 18862691 1.04
tpcds_q27/duckdb:vortex-file-compressed 25361683 24307582 1.04
tpcds_q28/duckdb:vortex-file-compressed 11427703 12130300 0.94
tpcds_q29/duckdb:vortex-file-compressed 40221971 39500017 1.02
tpcds_q30/duckdb:vortex-file-compressed 24462558 23840317 1.03
tpcds_q31/duckdb:vortex-file-compressed 29775416 28641107 1.04
tpcds_q32/duckdb:vortex-file-compressed 13242224 12856052 1.03
tpcds_q33/duckdb:vortex-file-compressed 22988045 24536034 0.94
tpcds_q34/duckdb:vortex-file-compressed 25241119 25171190 1.00
tpcds_q35/duckdb:vortex-file-compressed 63929661 63213201 1.01
tpcds_q36/duckdb:vortex-file-compressed 24177908 23880217 1.01
tpcds_q37/duckdb:vortex-file-compressed 19450575 18876659 1.03
tpcds_q38/duckdb:vortex-file-compressed 37718407 36023831 1.05
tpcds_q39/duckdb:vortex-file-compressed 35511472 34726560 1.02
tpcds_q40/duckdb:vortex-file-compressed 19908128 18976101 1.05
tpcds_q41/duckdb:vortex-file-compressed 9154979 9014429 1.02
tpcds_q42/duckdb:vortex-file-compressed 13699041 13278865 1.03
tpcds_q43/duckdb:vortex-file-compressed 20870167 20837167 1.00
tpcds_q44/duckdb:vortex-file-compressed 20888565 19828181 1.05
tpcds_q45/duckdb:vortex-file-compressed 30670479 29052987 1.06
tpcds_q46/duckdb:vortex-file-compressed 🚨 35178570 31394631 1.12
tpcds_q47/duckdb:vortex-file-compressed 51810051 51984265 1.00
tpcds_q48/duckdb:vortex-file-compressed 28471356 28770287 0.99
tpcds_q49/duckdb:vortex-file-compressed 31786189 31488605 1.01
tpcds_q50/duckdb:vortex-file-compressed 25300373 24849776 1.02
tpcds_q51/duckdb:vortex-file-compressed 103387853 105181488 0.98
tpcds_q52/duckdb:vortex-file-compressed 13559327 12328675 1.10
tpcds_q53/duckdb:vortex-file-compressed 22556053 21344589 1.06
tpcds_q54/duckdb:vortex-file-compressed 28015396 29057068 0.96
tpcds_q55/duckdb:vortex-file-compressed 12358000 12410454 1.00
tpcds_q56/duckdb:vortex-file-compressed 25445114 24785911 1.03
tpcds_q57/duckdb:vortex-file-compressed 41575598 41018497 1.01
tpcds_q58/duckdb:vortex-file-compressed 28988911 28929546 1.00
tpcds_q59/duckdb:vortex-file-compressed 56908593 56192380 1.01
tpcds_q60/duckdb:vortex-file-compressed 26068597 24603827 1.06
tpcds_q61/duckdb:vortex-file-compressed 30145385 29153762 1.03
tpcds_q62/duckdb:vortex-file-compressed 15689873 15903154 0.99
tpcds_q63/duckdb:vortex-file-compressed 20220692 21532522 0.94
tpcds_q64/duckdb:vortex-file-compressed 93612931 93648508 1.00
tpcds_q65/duckdb:vortex-file-compressed 23239089 22981371 1.01
tpcds_q66/duckdb:vortex-file-compressed 29840966 29257529 1.02
tpcds_q67/duckdb:vortex-file-compressed 143591929 138815202 1.03
tpcds_q68/duckdb:vortex-file-compressed 29804156 29792182 1.00
tpcds_q69/duckdb:vortex-file-compressed 39024298 38600074 1.01
tpcds_q70/duckdb:vortex-file-compressed 36947652 36314243 1.02
tpcds_q71/duckdb:vortex-file-compressed 20413697 20689358 0.99
tpcds_q72/duckdb:vortex-file-compressed 168894285 167351744 1.01
tpcds_q73/duckdb:vortex-file-compressed 25825545 24633896 1.05
tpcds_q74/duckdb:vortex-file-compressed 42215611 41470605 1.02
tpcds_q75/duckdb:vortex-file-compressed 50679312 49429198 1.03
tpcds_q76/duckdb:vortex-file-compressed 21943543 21719745 1.01
tpcds_q77/duckdb:vortex-file-compressed 23700048 23061227 1.03
tpcds_q78/duckdb:vortex-file-compressed 76184716 75748646 1.01
tpcds_q79/duckdb:vortex-file-compressed 25228457 24222871 1.04
tpcds_q80/duckdb:vortex-file-compressed 46328802 45718715 1.01
tpcds_q81/duckdb:vortex-file-compressed 29167919 28696706 1.02
tpcds_q82/duckdb:vortex-file-compressed 47564758 44900874 1.06
tpcds_q83/duckdb:vortex-file-compressed 25054751 25733540 0.97
tpcds_q84/duckdb:vortex-file-compressed 16766033 16447531 1.02
tpcds_q85/duckdb:vortex-file-compressed 39982776 39909015 1.00
tpcds_q86/duckdb:vortex-file-compressed 16872114 16736677 1.01
tpcds_q87/duckdb:vortex-file-compressed 39689636 42597415 0.93
tpcds_q88/duckdb:vortex-file-compressed 51348202 51008822 1.01
tpcds_q89/duckdb:vortex-file-compressed 21452788 21225457 1.01
tpcds_q90/duckdb:vortex-file-compressed 10199794 9731200 1.05
tpcds_q91/duckdb:vortex-file-compressed 21086647 20135495 1.05
tpcds_q92/duckdb:vortex-file-compressed 17779512 17584925 1.01
tpcds_q93/duckdb:vortex-file-compressed 29947642 29731438 1.01
tpcds_q94/duckdb:vortex-file-compressed 21550997 21180084 1.02
tpcds_q95/duckdb:vortex-file-compressed 146678753 160204985 0.92
tpcds_q96/duckdb:vortex-file-compressed 12097776 11989745 1.01
tpcds_q97/duckdb:vortex-file-compressed 38689314 37721799 1.03
tpcds_q98/duckdb:vortex-file-compressed 19044162 18480166 1.03
tpcds_q99/duckdb:vortex-file-compressed 23350100 21757854 1.07
duckdb / vortex-compact (1.007x ➖, 3↑ 2↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 27888228 27196587 1.03
tpcds_q02/duckdb:vortex-compact 🚨 42919721 38710272 1.11
tpcds_q03/duckdb:vortex-compact 45580635 45954024 0.99
tpcds_q04/duckdb:vortex-compact 104660645 103719794 1.01
tpcds_q05/duckdb:vortex-compact 41651227 39046986 1.07
tpcds_q06/duckdb:vortex-compact 39188314 37265492 1.05
tpcds_q07/duckdb:vortex-compact 34840601 35066095 0.99
tpcds_q08/duckdb:vortex-compact 40943939 40050428 1.02
tpcds_q09/duckdb:vortex-compact 19334261 18892954 1.02
tpcds_q10/duckdb:vortex-compact 52450477 50544659 1.04
tpcds_q11/duckdb:vortex-compact 74437722 72902971 1.02
tpcds_q12/duckdb:vortex-compact 22085664 21395482 1.03
tpcds_q13/duckdb:vortex-compact 50908251 51700737 0.98
tpcds_q14/duckdb:vortex-compact 115550295 113734940 1.02
tpcds_q15/duckdb:vortex-compact 29574812 29284063 1.01
tpcds_q16/duckdb:vortex-compact 27476865 26641514 1.03
tpcds_q17/duckdb:vortex-compact 54216115 55606366 0.97
tpcds_q18/duckdb:vortex-compact 49955511 47371608 1.05
tpcds_q19/duckdb:vortex-compact 44166103 43256601 1.02
tpcds_q20/duckdb:vortex-compact 21234430 20717252 1.02
tpcds_q21/duckdb:vortex-compact 18006037 17579507 1.02
tpcds_q22/duckdb:vortex-compact 78920460 74187797 1.06
tpcds_q23/duckdb:vortex-compact 106798316 107990856 0.99
tpcds_q24/duckdb:vortex-compact 56277599 57825703 0.97
tpcds_q25/duckdb:vortex-compact 54715032 53729985 1.02
tpcds_q26/duckdb:vortex-compact 🚀 27769542 31325564 0.89
tpcds_q27/duckdb:vortex-compact 37455011 35543762 1.05
tpcds_q28/duckdb:vortex-compact 35440060 33660558 1.05
tpcds_q29/duckdb:vortex-compact 52070431 53542153 0.97
tpcds_q30/duckdb:vortex-compact 30284376 27860343 1.09
tpcds_q31/duckdb:vortex-compact 37464128 34114452 1.10
tpcds_q32/duckdb:vortex-compact 20913676 21081348 0.99
tpcds_q33/duckdb:vortex-compact 30881390 32702686 0.94
tpcds_q34/duckdb:vortex-compact 30678212 29506878 1.04
tpcds_q35/duckdb:vortex-compact 74341732 73139308 1.02
tpcds_q36/duckdb:vortex-compact 36141177 35130123 1.03
tpcds_q37/duckdb:vortex-compact 24222975 23472789 1.03
tpcds_q38/duckdb:vortex-compact 42660302 39676223 1.08
tpcds_q39/duckdb:vortex-compact 38331814 37599425 1.02
tpcds_q40/duckdb:vortex-compact 23850061 24314811 0.98
tpcds_q41/duckdb:vortex-compact 10557024 10528660 1.00
tpcds_q42/duckdb:vortex-compact 19474190 18708308 1.04
tpcds_q43/duckdb:vortex-compact 🚀 28045325 32855862 0.85
tpcds_q44/duckdb:vortex-compact 28555506 29643516 0.96
tpcds_q45/duckdb:vortex-compact 35340666 36756213 0.96
tpcds_q46/duckdb:vortex-compact 45855207 47033829 0.97
tpcds_q47/duckdb:vortex-compact 63007748 63282240 1.00
tpcds_q48/duckdb:vortex-compact 43939544 44721015 0.98
tpcds_q49/duckdb:vortex-compact 47526721 46827478 1.01
tpcds_q50/duckdb:vortex-compact 36964557 37389831 0.99
tpcds_q51/duckdb:vortex-compact 112447255 109202863 1.03
tpcds_q52/duckdb:vortex-compact 19399322 18637707 1.04
tpcds_q53/duckdb:vortex-compact 33026994 31539544 1.05
tpcds_q54/duckdb:vortex-compact 🚀 35411961 40155365 0.88
tpcds_q55/duckdb:vortex-compact 18534874 18366419 1.01
tpcds_q56/duckdb:vortex-compact 31847224 31954336 1.00
tpcds_q57/duckdb:vortex-compact 45782580 45254007 1.01
tpcds_q58/duckdb:vortex-compact 36490746 36929942 0.99
tpcds_q59/duckdb:vortex-compact 68268065 67073585 1.02
tpcds_q60/duckdb:vortex-compact 36450627 34603286 1.05
tpcds_q61/duckdb:vortex-compact 53109958 52916477 1.00
tpcds_q62/duckdb:vortex-compact 20822837 20711679 1.01
tpcds_q63/duckdb:vortex-compact 31476581 30156235 1.04
tpcds_q64/duckdb:vortex-compact 125739729 124346210 1.01
tpcds_q65/duckdb:vortex-compact 30761231 30320068 1.01
tpcds_q66/duckdb:vortex-compact 34534591 35545758 0.97
tpcds_q67/duckdb:vortex-compact 152546380 151367512 1.01
tpcds_q68/duckdb:vortex-compact 45171934 47059758 0.96
tpcds_q69/duckdb:vortex-compact 54036370 53896782 1.00
tpcds_q70/duckdb:vortex-compact 60759855 57047439 1.07
tpcds_q71/duckdb:vortex-compact 28596984 29558692 0.97
tpcds_q72/duckdb:vortex-compact 183819960 181048527 1.02
tpcds_q73/duckdb:vortex-compact 28473575 28047367 1.02
tpcds_q74/duckdb:vortex-compact 49398993 49929327 0.99
tpcds_q75/duckdb:vortex-compact 62539516 62338206 1.00
tpcds_q76/duckdb:vortex-compact 30189232 28885938 1.05
tpcds_q77/duckdb:vortex-compact 37397266 36284166 1.03
tpcds_q78/duckdb:vortex-compact 88531604 85852247 1.03
tpcds_q79/duckdb:vortex-compact 38084253 41327134 0.92
tpcds_q80/duckdb:vortex-compact 🚨 77236181 69321373 1.11
tpcds_q81/duckdb:vortex-compact 34088533 33819638 1.01
tpcds_q82/duckdb:vortex-compact 50098892 49659265 1.01
tpcds_q83/duckdb:vortex-compact 35265497 35084691 1.01
tpcds_q84/duckdb:vortex-compact 20298253 21258832 0.95
tpcds_q85/duckdb:vortex-compact 52057684 52613855 0.99
tpcds_q86/duckdb:vortex-compact 21337364 20792821 1.03
tpcds_q87/duckdb:vortex-compact 45022454 43840144 1.03
tpcds_q88/duckdb:vortex-compact 74699907 73362365 1.02
tpcds_q89/duckdb:vortex-compact 33137347 32135847 1.03
tpcds_q90/duckdb:vortex-compact 11038262 10811815 1.02
tpcds_q91/duckdb:vortex-compact 40137437 40604134 0.99
tpcds_q92/duckdb:vortex-compact 42012596 45628037 0.92
tpcds_q93/duckdb:vortex-compact 32376045 33081663 0.98
tpcds_q94/duckdb:vortex-compact 27195109 27037307 1.01
tpcds_q95/duckdb:vortex-compact 157655530 163312444 0.97
tpcds_q96/duckdb:vortex-compact 16221464 15815806 1.03
tpcds_q97/duckdb:vortex-compact 43403476 45262391 0.96
tpcds_q98/duckdb:vortex-compact 26983197 28099039 0.96
tpcds_q99/duckdb:vortex-compact 25920671 26117827 0.99
duckdb / parquet (1.008x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29974956 28962367 1.03
tpcds_q02/duckdb:parquet 23788451 24439642 0.97
tpcds_q03/duckdb:parquet 13382922 13148208 1.02
tpcds_q04/duckdb:parquet 167730600 165435512 1.01
tpcds_q05/duckdb:parquet 32328312 30610699 1.06
tpcds_q06/duckdb:parquet 33845330 34332281 0.99
tpcds_q07/duckdb:parquet 23906991 24421425 0.98
tpcds_q08/duckdb:parquet 30441705 29658614 1.03
tpcds_q09/duckdb:parquet 44936925 45257766 0.99
tpcds_q10/duckdb:parquet 37875175 37538190 1.01
tpcds_q11/duckdb:parquet 85570640 93239934 0.92
tpcds_q12/duckdb:parquet 17245978 17109136 1.01
tpcds_q13/duckdb:parquet 35444629 34783481 1.02
tpcds_q14/duckdb:parquet 104495754 102391381 1.02
tpcds_q15/duckdb:parquet 30895114 30899195 1.00
tpcds_q16/duckdb:parquet 23164370 22734187 1.02
tpcds_q17/duckdb:parquet 38728049 38473654 1.01
tpcds_q18/duckdb:parquet 49100890 47833729 1.03
tpcds_q19/duckdb:parquet 31637943 31837684 0.99
tpcds_q20/duckdb:parquet 18655679 18721673 1.00
tpcds_q21/duckdb:parquet 11831552 11582518 1.02
tpcds_q22/duckdb:parquet 72249387 66885942 1.08
tpcds_q23/duckdb:parquet 83467732 80803443 1.03
tpcds_q24/duckdb:parquet 47172515 46837428 1.01
tpcds_q25/duckdb:parquet 36714039 35180779 1.04
tpcds_q26/duckdb:parquet 39603521 38279483 1.03
tpcds_q27/duckdb:parquet 52829936 53505329 0.99
tpcds_q28/duckdb:parquet 43335464 42365630 1.02
tpcds_q29/duckdb:parquet 36656059 36633464 1.00
tpcds_q30/duckdb:parquet 37910286 37338377 1.02
tpcds_q31/duckdb:parquet 29892557 27711795 1.08
tpcds_q32/duckdb:parquet 12474015 12560032 0.99
tpcds_q33/duckdb:parquet 25078512 23957667 1.05
tpcds_q34/duckdb:parquet 22786580 22590455 1.01
tpcds_q35/duckdb:parquet 62498731 62018663 1.01
tpcds_q36/duckdb:parquet 22751384 22373101 1.02
tpcds_q37/duckdb:parquet 14128446 14417688 0.98
tpcds_q38/duckdb:parquet 36618724 36549974 1.00
tpcds_q39/duckdb:parquet 33565262 32855421 1.02
tpcds_q40/duckdb:parquet 19790117 19508575 1.01
tpcds_q41/duckdb:parquet 8782434 8859184 0.99
tpcds_q42/duckdb:parquet 13178464 12019062 1.10
tpcds_q43/duckdb:parquet 18192383 17653193 1.03
tpcds_q44/duckdb:parquet 27236905 26511937 1.03
tpcds_q45/duckdb:parquet 28718897 28891624 0.99
tpcds_q46/duckdb:parquet 47858164 47273748 1.01
tpcds_q47/duckdb:parquet 50895625 49724860 1.02
tpcds_q48/duckdb:parquet 32947704 32473991 1.01
tpcds_q49/duckdb:parquet 29027091 28900799 1.00
tpcds_q50/duckdb:parquet 26386187 25906147 1.02
tpcds_q51/duckdb:parquet 105351965 101534126 1.04
tpcds_q52/duckdb:parquet 13524528 13255748 1.02
tpcds_q53/duckdb:parquet 19390471 19513723 0.99
tpcds_q54/duckdb:parquet 29166149 28945617 1.01
tpcds_q55/duckdb:parquet 12585000 12989924 0.97
tpcds_q56/duckdb:parquet 23781069 24911738 0.95
tpcds_q57/duckdb:parquet 38689445 37864115 1.02
tpcds_q58/duckdb:parquet 26980662 25882245 1.04
tpcds_q59/duckdb:parquet 36462236 36949527 0.99
tpcds_q60/duckdb:parquet 24999983 25243301 0.99
tpcds_q61/duckdb:parquet 34412405 34206358 1.01
tpcds_q62/duckdb:parquet 12603413 12749001 0.99
tpcds_q63/duckdb:parquet 17095343 17453283 0.98
tpcds_q64/duckdb:parquet 74542137 77019040 0.97
tpcds_q65/duckdb:parquet 22270467 21763519 1.02
tpcds_q66/duckdb:parquet 29360933 32178742 0.91
tpcds_q67/duckdb:parquet 133859862 136675444 0.98
tpcds_q68/duckdb:parquet 39629793 39179687 1.01
tpcds_q69/duckdb:parquet 38411415 37910571 1.01
tpcds_q70/duckdb:parquet 23025339 23454949 0.98
tpcds_q71/duckdb:parquet 23784874 22672996 1.05
tpcds_q72/duckdb:parquet 168462857 165927476 1.02
tpcds_q73/duckdb:parquet 19954932 20268767 0.98
tpcds_q74/duckdb:parquet 126827669 126166924 1.01
tpcds_q75/duckdb:parquet 57180998 55598931 1.03
tpcds_q76/duckdb:parquet 22225145 22647079 0.98
tpcds_q77/duckdb:parquet 26282518 25554393 1.03
tpcds_q78/duckdb:parquet 77785046 77445725 1.00
tpcds_q79/duckdb:parquet 29957940 29490594 1.02
tpcds_q80/duckdb:parquet 44591975 43173337 1.03
tpcds_q81/duckdb:parquet 35804047 35514653 1.01
tpcds_q82/duckdb:parquet 17426727 17153727 1.02
tpcds_q83/duckdb:parquet 18562008 18041703 1.03
tpcds_q84/duckdb:parquet 20467593 21677269 0.94
tpcds_q85/duckdb:parquet 41097989 41945541 0.98
tpcds_q86/duckdb:parquet 13777640 13901187 0.99
tpcds_q87/duckdb:parquet 42226253 38992529 1.08
tpcds_q88/duckdb:parquet 54455794 53081185 1.03
tpcds_q89/duckdb:parquet 21908295 21897958 1.00
tpcds_q90/duckdb:parquet 8461274 8189067 1.03
tpcds_q91/duckdb:parquet 25372004 25675796 0.99
tpcds_q92/duckdb:parquet 13389308 13212383 1.01
tpcds_q93/duckdb:parquet 31842231 31832446 1.00
tpcds_q94/duckdb:parquet 18097677 18015713 1.00
tpcds_q95/duckdb:parquet 124550719 138153627 0.90
tpcds_q96/duckdb:parquet 11039880 10558600 1.05
tpcds_q97/duckdb:parquet 38931543 38234747 1.02
tpcds_q98/duckdb:parquet 23444973 24087110 0.97
tpcds_q99/duckdb:parquet 20306695 20304064 1.00
duckdb / duckdb (1.017x ➖, 1↑ 2↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21933160 22774813 0.96
tpcds_q02/duckdb:duckdb 19295125 20225952 0.95
tpcds_q03/duckdb:duckdb 10164767 10040191 1.01
tpcds_q04/duckdb:duckdb 179548216 179914655 1.00
tpcds_q05/duckdb:duckdb 21241756 21132010 1.01
tpcds_q06/duckdb:duckdb 28091744 27304600 1.03
tpcds_q07/duckdb:duckdb 41063986 39673220 1.04
tpcds_q08/duckdb:duckdb 119799072 119668918 1.00
tpcds_q09/duckdb:duckdb 20691081 20658820 1.00
tpcds_q10/duckdb:duckdb 27475669 27494158 1.00
tpcds_q11/duckdb:duckdb 90139647 89437362 1.01
tpcds_q12/duckdb:duckdb 14259659 13988635 1.02
tpcds_q13/duckdb:duckdb 26150763 25766848 1.01
tpcds_q14/duckdb:duckdb 91888055 95040537 0.97
tpcds_q15/duckdb:duckdb 25346444 24321249 1.04
tpcds_q16/duckdb:duckdb 19548134 18972460 1.03
tpcds_q17/duckdb:duckdb 24971311 24146528 1.03
tpcds_q18/duckdb:duckdb 47041862 47131982 1.00
tpcds_q19/duckdb:duckdb 19131054 18877700 1.01
tpcds_q20/duckdb:duckdb 14147780 14140388 1.00
tpcds_q21/duckdb:duckdb 8018605 7561140 1.06
tpcds_q22/duckdb:duckdb 66502187 61422942 1.08
tpcds_q23/duckdb:duckdb 79780449 79068713 1.01
tpcds_q24/duckdb:duckdb 25370691 25410230 1.00
tpcds_q25/duckdb:duckdb 19224311 18663991 1.03
tpcds_q26/duckdb:duckdb 28996771 28341419 1.02
tpcds_q27/duckdb:duckdb 42049758 40583957 1.04
tpcds_q28/duckdb:duckdb 25983082 25509640 1.02
tpcds_q29/duckdb:duckdb 23407543 23082218 1.01
tpcds_q30/duckdb:duckdb 31525798 30611596 1.03
tpcds_q31/duckdb:duckdb 51848013 52328181 0.99
tpcds_q32/duckdb:duckdb 8519387 8486145 1.00
tpcds_q33/duckdb:duckdb 16003308 15992017 1.00
tpcds_q34/duckdb:duckdb 18944748 19172068 0.99
tpcds_q35/duckdb:duckdb 36773111 35772874 1.03
tpcds_q36/duckdb:duckdb 70335752 70560757 1.00
tpcds_q37/duckdb:duckdb 8963263 8723160 1.03
tpcds_q38/duckdb:duckdb 33908254 32643788 1.04
tpcds_q39/duckdb:duckdb 28042116 27897950 1.01
tpcds_q40/duckdb:duckdb 14731795 14577725 1.01
tpcds_q41/duckdb:duckdb 9373196 9129027 1.03
tpcds_q42/duckdb:duckdb 🚨 9703291 8088589 1.20
tpcds_q43/duckdb:duckdb 14747651 13629037 1.08
tpcds_q44/duckdb:duckdb 15446269 15627865 0.99
tpcds_q45/duckdb:duckdb 18978962 18267425 1.04
tpcds_q46/duckdb:duckdb 38987538 38191245 1.02
tpcds_q47/duckdb:duckdb 46340988 45937729 1.01
tpcds_q48/duckdb:duckdb 25058672 24845639 1.01
tpcds_q49/duckdb:duckdb 21803619 20473045 1.06
tpcds_q50/duckdb:duckdb 16146584 15871761 1.02
tpcds_q51/duckdb:duckdb 99831452 99877920 1.00
tpcds_q52/duckdb:duckdb 🚀 9399263 10827637 0.87
tpcds_q53/duckdb:duckdb 17919192 17691751 1.01
tpcds_q54/duckdb:duckdb 18562090 18552524 1.00
tpcds_q55/duckdb:duckdb 8738514 9172654 0.95
tpcds_q56/duckdb:duckdb 16216615 16385393 0.99
tpcds_q57/duckdb:duckdb 36603912 36011231 1.02
tpcds_q58/duckdb:duckdb 17084646 16631126 1.03
tpcds_q59/duckdb:duckdb 37131544 36778983 1.01
tpcds_q60/duckdb:duckdb 18847003 18582064 1.01
tpcds_q61/duckdb:duckdb 16836148 17062127 0.99
tpcds_q62/duckdb:duckdb 9819914 9735512 1.01
tpcds_q63/duckdb:duckdb 16434986 16163718 1.02
tpcds_q64/duckdb:duckdb 58920269 56777189 1.04
tpcds_q65/duckdb:duckdb 36380015 36292517 1.00
tpcds_q66/duckdb:duckdb 26217044 26198901 1.00
tpcds_q67/duckdb:duckdb 129427508 133862163 0.97
tpcds_q68/duckdb:duckdb 27323867 26783470 1.02
tpcds_q69/duckdb:duckdb 28855495 27325557 1.06
tpcds_q70/duckdb:duckdb 17538212 16289187 1.08
tpcds_q71/duckdb:duckdb 16506387 15480676 1.07
tpcds_q72/duckdb:duckdb 46346863 45468192 1.02
tpcds_q73/duckdb:duckdb 14347584 14671935 0.98
tpcds_q74/duckdb:duckdb 146095358 147017094 0.99
tpcds_q75/duckdb:duckdb 46501929 45236071 1.03
tpcds_q76/duckdb:duckdb 15128688 14712557 1.03
tpcds_q77/duckdb:duckdb 15058072 14684078 1.03
tpcds_q78/duckdb:duckdb 65558750 65483698 1.00
tpcds_q79/duckdb:duckdb 20325118 19643775 1.03
tpcds_q80/duckdb:duckdb 32688902 32919285 0.99
tpcds_q81/duckdb:duckdb 41292390 39728591 1.04
tpcds_q82/duckdb:duckdb 10743116 11611096 0.93
tpcds_q83/duckdb:duckdb 11049383 10496430 1.05
tpcds_q84/duckdb:duckdb 14755685 14648110 1.01
tpcds_q85/duckdb:duckdb 26168048 25385408 1.03
tpcds_q86/duckdb:duckdb 12132529 11836850 1.02
tpcds_q87/duckdb:duckdb 36582446 35721276 1.02
tpcds_q88/duckdb:duckdb 29788997 29360721 1.01
tpcds_q89/duckdb:duckdb 22593771 21598448 1.05
tpcds_q90/duckdb:duckdb 6156714 6130636 1.00
tpcds_q91/duckdb:duckdb 15457883 14834711 1.04
tpcds_q92/duckdb:duckdb 10000703 9718736 1.03
tpcds_q93/duckdb:duckdb 23712966 24070252 0.99
tpcds_q94/duckdb:duckdb 14725021 14262455 1.03
tpcds_q95/duckdb:duckdb 🚨 131561955 110350331 1.19
tpcds_q96/duckdb:duckdb 5801899 5746480 1.01
tpcds_q97/duckdb:duckdb 32719923 31704560 1.03
tpcds_q98/duckdb:duckdb 21379147 21161912 1.01
tpcds_q99/duckdb:duckdb 16912496 16698868 1.01
File Size Changes (6 files changed, -0.0% overall, 2↑ 4↓)
File Scale Format Base HEAD Change %
item.vortex 1.0 vortex-compact 994.34 KB 994.64 KB +304 B +0.0%
catalog_page.vortex 1.0 vortex-file-compressed 571.27 KB 571.33 KB +64 B +0.0%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB 320 B -0.0%
customer_address.vortex 1.0 vortex-file-compressed 827.32 KB 826.31 KB 1.01 KB -0.1%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.26 MB 6.23 KB -0.1%
time_dim.vortex 1.0 vortex-file-compressed 381.35 KB 380.46 KB 912 B -0.2%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 271.86 MB → 271.85 MB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.1%
Engines: DataFusion No clear signal (+17.0%, environment too noisy confidence) · DuckDB No clear signal (-0.2%, environment too noisy confidence)
Vortex (geomean): 1.115x ➖
Parquet (geomean): 1.031x ➖
Shifts: Parquet (control) +3.1% · Median polish +3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.363x ❌, 0↑ 3↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 77729906 38866396 2.00
fineweb_q01/datafusion:vortex-file-compressed 🚨 1667255466 508150208 3.28
fineweb_q02/datafusion:vortex-file-compressed 🚨 1483462641 534036167 2.78
fineweb_q03/datafusion:vortex-file-compressed 1182534252 1205318032 0.98
fineweb_q04/datafusion:vortex-file-compressed 1167411857 1230851281 0.95
fineweb_q05/datafusion:vortex-file-compressed 1077754304 1194641274 0.90
fineweb_q06/datafusion:vortex-file-compressed 1466105573 1427322537 1.03
fineweb_q07/datafusion:vortex-file-compressed 1238158188 1142022790 1.08
fineweb_q08/datafusion:vortex-file-compressed 463959954 488060388 0.95
datafusion / vortex-compact (1.062x ➖, 0↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 34370900 42250898 0.81
fineweb_q01/datafusion:vortex-compact 730618233 601542966 1.21
fineweb_q02/datafusion:vortex-compact 665777322 606519920 1.10
fineweb_q03/datafusion:vortex-compact 1375583303 1379523562 1.00
fineweb_q04/datafusion:vortex-compact 1649954638 1608102128 1.03
fineweb_q05/datafusion:vortex-compact 1344620694 1359164312 0.99
fineweb_q06/datafusion:vortex-compact 1385440850 1293153418 1.07
fineweb_q07/datafusion:vortex-compact 1270937195 1177721024 1.08
fineweb_q08/datafusion:vortex-compact 🚨 569158757 421050949 1.35
datafusion / parquet (1.028x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1255161469 1314445518 0.95
fineweb_q01/datafusion:parquet 2101349246 1950199281 1.08
fineweb_q02/datafusion:parquet 1984140870 2201889446 0.90
fineweb_q03/datafusion:parquet 1841364634 1816429386 1.01
fineweb_q04/datafusion:parquet 2070764352 1971223223 1.05
fineweb_q05/datafusion:parquet 1999776801 2071059498 0.97
fineweb_q06/datafusion:parquet 1983757229 1987868080 1.00
fineweb_q07/datafusion:parquet 2005889360 1873313577 1.07
fineweb_q08/datafusion:parquet 2361254789 1880567999 1.26
duckdb / vortex-file-compressed (1.076x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 86150424 83177357 1.04
fineweb_q01/duckdb:vortex-file-compressed 629451480 636748301 0.99
fineweb_q02/duckdb:vortex-file-compressed 691589974 560522320 1.23
fineweb_q03/duckdb:vortex-file-compressed 1495371960 1282590007 1.17
fineweb_q04/duckdb:vortex-file-compressed 1475974027 1478870177 1.00
fineweb_q05/duckdb:vortex-file-compressed 1334044228 1351126858 0.99
fineweb_q06/duckdb:vortex-file-compressed 1915922802 1576023563 1.22
fineweb_q07/duckdb:vortex-file-compressed 1373145458 1293214593 1.06
fineweb_q08/duckdb:vortex-file-compressed 567759838 551602144 1.03
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 62754403 85955228 0.73
fineweb_q01/duckdb:vortex-compact 564360661 630242889 0.90
fineweb_q02/duckdb:vortex-compact 625998994 572137327 1.09
fineweb_q03/duckdb:vortex-compact 1868249909 1703136543 1.10
fineweb_q04/duckdb:vortex-compact 1864577668 1897828761 0.98
fineweb_q05/duckdb:vortex-compact 1665076282 1691528517 0.98
fineweb_q06/duckdb:vortex-compact 1771079471 1558599479 1.14
fineweb_q07/duckdb:vortex-compact 1442892131 1450954514 0.99
fineweb_q08/duckdb:vortex-compact 582527037 534745697 1.09
duckdb / parquet (1.035x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1169724630 1160750552 1.01
fineweb_q01/duckdb:parquet 1389939172 1501594651 0.93
fineweb_q02/duckdb:parquet 1625135209 1530922930 1.06
fineweb_q03/duckdb:parquet 3735660061 3774677780 0.99
fineweb_q04/duckdb:parquet 2183857126 1896427309 1.15
fineweb_q05/duckdb:parquet 2508279468 2140493594 1.17
fineweb_q06/duckdb:parquet 4703009254 4547440203 1.03
fineweb_q07/duckdb:parquet 2677117247 2776330502 0.96
fineweb_q08/duckdb:parquet 1145612192 1110476928 1.03

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): 1.021x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11787494 11775185 1.00
statpopgen_q01/duckdb:vortex-file-compressed 25814977 26516998 0.97
statpopgen_q02/duckdb:vortex-file-compressed 530793938 537109449 0.99
statpopgen_q03/duckdb:vortex-file-compressed 1062779907 1075651655 0.99
statpopgen_q04/duckdb:vortex-file-compressed 1072341677 1065517682 1.01
statpopgen_q05/duckdb:vortex-file-compressed 494323469 478633645 1.03
statpopgen_q06/duckdb:vortex-file-compressed 1541478951 1533419089 1.01
statpopgen_q07/duckdb:vortex-file-compressed 198558062 199684530 0.99
statpopgen_q08/duckdb:vortex-file-compressed 227406546 225465902 1.01
statpopgen_q09/duckdb:vortex-file-compressed 839822135 835707684 1.00
statpopgen_q10/duckdb:vortex-file-compressed 2582777039 2544432137 1.02
duckdb / vortex-compact (1.041x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11580160 11576177 1.00
statpopgen_q01/duckdb:vortex-compact 215974832 213534475 1.01
statpopgen_q02/duckdb:vortex-compact 570744784 548828866 1.04
statpopgen_q03/duckdb:vortex-compact 1230955875 1157119794 1.06
statpopgen_q04/duckdb:vortex-compact 1210477042 1149918959 1.05
statpopgen_q05/duckdb:vortex-compact 587904251 560698205 1.05
statpopgen_q06/duckdb:vortex-compact 1544328619 1503119373 1.03
statpopgen_q07/duckdb:vortex-compact 929409124 885193659 1.05
statpopgen_q08/duckdb:vortex-compact 960865570 917658872 1.05
statpopgen_q09/duckdb:vortex-compact 980307031 925206032 1.06
statpopgen_q10/duckdb:vortex-compact 2735160359 2588065245 1.06
duckdb / parquet (1.006x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 295378895 301267963 0.98
statpopgen_q01/duckdb:parquet 382091029 375183002 1.02
statpopgen_q02/duckdb:parquet 763968735 754743168 1.01
statpopgen_q03/duckdb:parquet 1191103559 1173394393 1.02
statpopgen_q04/duckdb:parquet 1205083822 1180378073 1.02
statpopgen_q05/duckdb:parquet 808056735 810529125 1.00
statpopgen_q06/duckdb:parquet 1407932784 1432158827 0.98
statpopgen_q07/duckdb:parquet 844495505 851273333 0.99
statpopgen_q08/duckdb:parquet 879637553 838917585 1.05
statpopgen_q09/duckdb:parquet 1006952657 998285619 1.01
statpopgen_q10/duckdb:parquet 2187909393 2207835787 0.99
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 104.20 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Random Access

Vortex (geomean): 0.858x ✅
Parquet (geomean): 0.963x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.918x ➖, 16↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 1837480 2575277 0.71
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1064393 1127957 0.94
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8204605134 8788663536 0.93
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8177910093 8736411068 0.94
random-access/feature-vectors/correlated/vortex-tokio-local-disk 3762465 3896228 0.97
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 2913476 3575814 0.81
random-access/feature-vectors/uniform/lance-tokio-local-disk 1202108 1228427 0.98
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1847160 1933320 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8220618647 8571296963 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8202676790 8567531652 0.96
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 4501925 5008215 0.90
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 6121100 6978336 0.88
random-access/lance-tokio-local-disk 641319 666965 0.96
random-access/lance-tokio-local-disk-footer 1299232 1363390 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk 237456 259978 0.91
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 584960 624264 0.94
random-access/nested-lists/correlated/parquet-tokio-local-disk 130779712 132927369 0.98
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 130939215 132012294 0.99
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 523737 620636 0.84
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 617865 732246 0.84
random-access/nested-lists/uniform/lance-tokio-local-disk 1005515 1043567 0.96
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1359395 1413296 0.96
random-access/nested-lists/uniform/parquet-tokio-local-disk 130525871 131652008 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130390725 133835822 0.97
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 2003407 2286347 0.88
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2073132 2347814 0.88
random-access/nested-structs/correlated/lance-tokio-local-disk 367582 392329 0.94
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 549660 589134 0.93
random-access/nested-structs/correlated/parquet-tokio-local-disk 23814729 24652085 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 23583645 24145788 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 669092 767948 0.87
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 730885 863610 0.85
random-access/nested-structs/uniform/lance-tokio-local-disk 2641030 2753090 0.96
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2759580 2866119 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 23479397 24218271 0.97
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 23479380 24629222 0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1491656 1833034 0.81
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1592572 1847129 0.86
random-access/parquet-tokio-local-disk 167806978 175149523 0.96
random-access/parquet-tokio-local-disk-footer 166807994 174829202 0.95
random-access/taxi/correlated/lance-tokio-local-disk 942874 984698 0.96
random-access/taxi/correlated/lance-tokio-local-disk-footer 1828481 2017295 0.91
random-access/taxi/correlated/parquet-tokio-local-disk 251741484 263458864 0.96
random-access/taxi/correlated/parquet-tokio-local-disk-footer 251761845 263462923 0.96
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1366282 1861660 0.73
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1602397 1942855 0.82
random-access/taxi/uniform/lance-tokio-local-disk 9513986 9559852 1.00
random-access/taxi/uniform/lance-tokio-local-disk-footer 9948010 10267210 0.97
random-access/taxi/uniform/parquet-tokio-local-disk 266690792 279354896 0.95
random-access/taxi/uniform/parquet-tokio-local-disk-footer 267283576 278972754 0.96
random-access/taxi/uniform/vortex-tokio-local-disk 3801608 4187256 0.91
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4063128 4463839 0.91
random-access/vortex-tokio-local-disk 🚀 992064 1146297 0.87
random-access/vortex-tokio-local-disk-footer 🚀 1087996 1311911 0.83

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Engines: DataFusion No clear signal (+1.3%, low confidence) · DuckDB No clear signal (+1.9%, low confidence)
Vortex (geomean): 1.070x ➖
Parquet (geomean): 1.050x ➖
Shifts: Parquet (control) +5.0% · Median polish +7.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.073x ➖, 0↑ 3↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 421153817 391097945 1.08
tpch_q02/datafusion:vortex-file-compressed 117944579 109709942 1.08
tpch_q03/datafusion:vortex-file-compressed 229394169 209555736 1.09
tpch_q04/datafusion:vortex-file-compressed 119767529 110142256 1.09
tpch_q05/datafusion:vortex-file-compressed 408827250 374882886 1.09
tpch_q06/datafusion:vortex-file-compressed 🚨 40715788 34908899 1.17
tpch_q07/datafusion:vortex-file-compressed 541624767 501893893 1.08
tpch_q08/datafusion:vortex-file-compressed 394536764 364524886 1.08
tpch_q09/datafusion:vortex-file-compressed 690539731 645796663 1.07
tpch_q10/datafusion:vortex-file-compressed 246620270 229879808 1.07
tpch_q11/datafusion:vortex-file-compressed 88650650 84268501 1.05
tpch_q12/datafusion:vortex-file-compressed 123835555 114024370 1.09
tpch_q13/datafusion:vortex-file-compressed 233676154 217284604 1.08
tpch_q14/datafusion:vortex-file-compressed 53133737 52691563 1.01
tpch_q15/datafusion:vortex-file-compressed 104029225 95931408 1.08
tpch_q16/datafusion:vortex-file-compressed 79614139 74307436 1.07
tpch_q17/datafusion:vortex-file-compressed 692976718 645179119 1.07
tpch_q18/datafusion:vortex-file-compressed 937150811 870996551 1.08
tpch_q19/datafusion:vortex-file-compressed 63699742 67722208 0.94
tpch_q20/datafusion:vortex-file-compressed 🚨 179556949 160605978 1.12
tpch_q21/datafusion:vortex-file-compressed 🚨 742508871 660916634 1.12
tpch_q22/datafusion:vortex-file-compressed 67811378 66102563 1.03
datafusion / vortex-compact (1.078x ➖, 0↑ 2↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 467664794 436893111 1.07
tpch_q02/datafusion:vortex-compact 121342897 113955910 1.06
tpch_q03/datafusion:vortex-compact 224045510 212217300 1.06
tpch_q04/datafusion:vortex-compact 124146048 115966920 1.07
tpch_q05/datafusion:vortex-compact 411982731 376961277 1.09
tpch_q06/datafusion:vortex-compact 63134832 58160484 1.09
tpch_q07/datafusion:vortex-compact 568506327 522998197 1.09
tpch_q08/datafusion:vortex-compact 399178790 370446252 1.08
tpch_q09/datafusion:vortex-compact 700753726 643617144 1.09
tpch_q10/datafusion:vortex-compact 267824800 249789392 1.07
tpch_q11/datafusion:vortex-compact 95032271 87623605 1.08
tpch_q12/datafusion:vortex-compact 167905231 155956341 1.08
tpch_q13/datafusion:vortex-compact 281440851 262044365 1.07
tpch_q14/datafusion:vortex-compact 74008985 69148478 1.07
tpch_q15/datafusion:vortex-compact 165561628 152856284 1.08
tpch_q16/datafusion:vortex-compact 84721281 82196274 1.03
tpch_q17/datafusion:vortex-compact 696008255 653258791 1.07
tpch_q18/datafusion:vortex-compact 949984855 870943859 1.09
tpch_q19/datafusion:vortex-compact 124818806 118480839 1.05
tpch_q20/datafusion:vortex-compact 200629736 186345890 1.08
tpch_q21/datafusion:vortex-compact 🚨 758054026 673462056 1.13
tpch_q22/datafusion:vortex-compact 🚨 78374985 70427411 1.11
datafusion / parquet (1.065x ➖, 0↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 489628363 477133623 1.03
tpch_q02/datafusion:parquet 185075661 174548171 1.06
tpch_q03/datafusion:parquet 308272898 286149751 1.08
tpch_q04/datafusion:parquet 134274566 129627795 1.04
tpch_q05/datafusion:parquet 🚨 481755047 436169978 1.10
tpch_q06/datafusion:parquet 134771901 135448826 1.00
tpch_q07/datafusion:parquet 655228026 610379408 1.07
tpch_q08/datafusion:parquet 512075596 466691362 1.10
tpch_q09/datafusion:parquet 833739267 759251608 1.10
tpch_q10/datafusion:parquet 540415380 502428692 1.08
tpch_q11/datafusion:parquet 122171036 117463228 1.04
tpch_q12/datafusion:parquet 201617286 200697856 1.00
tpch_q13/datafusion:parquet 350573399 330322389 1.06
tpch_q14/datafusion:parquet 172289330 159556106 1.08
tpch_q15/datafusion:parquet 274948991 250326846 1.10
tpch_q16/datafusion:parquet 140110000 127884215 1.10
tpch_q17/datafusion:parquet 746194186 686793578 1.09
tpch_q18/datafusion:parquet 976875238 912889303 1.07
tpch_q19/datafusion:parquet 280936589 256921545 1.09
tpch_q20/datafusion:parquet 309746357 298540316 1.04
tpch_q21/datafusion:parquet 777229871 707093165 1.10
tpch_q22/datafusion:parquet 225393516 218790835 1.03
datafusion / arrow (1.086x ➖, 0↑ 6↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 656005188 596573613 1.10
tpch_q02/datafusion:arrow 178618401 166493696 1.07
tpch_q03/datafusion:arrow 515820317 475712653 1.08
tpch_q04/datafusion:arrow 🚨 383964279 338526031 1.13
tpch_q05/datafusion:arrow 1037132720 950005702 1.09
tpch_q06/datafusion:arrow 🚨 311742994 280796027 1.11
tpch_q07/datafusion:arrow 1269298109 1168572605 1.09
tpch_q08/datafusion:arrow 1244742328 1150458799 1.08
tpch_q09/datafusion:arrow 1449244748 1346542585 1.08
tpch_q10/datafusion:arrow 641109359 595988115 1.08
tpch_q11/datafusion:arrow 149412751 140200288 1.07
tpch_q12/datafusion:arrow 861164675 809618760 1.06
tpch_q13/datafusion:arrow 531449279 511198357 1.04
tpch_q14/datafusion:arrow 🚨 362618174 320540511 1.13
tpch_q15/datafusion:arrow 🚨 772783968 690936162 1.12
tpch_q16/datafusion:arrow 111367656 105326264 1.06
tpch_q17/datafusion:arrow 1461883635 1339300470 1.09
tpch_q18/datafusion:arrow 2072692741 1935039573 1.07
tpch_q19/datafusion:arrow 525711050 485238062 1.08
tpch_q20/datafusion:arrow 🚨 542060325 481060516 1.13
tpch_q21/datafusion:arrow 3114272935 3001687582 1.04
tpch_q22/datafusion:arrow 🚨 141397711 128311906 1.10
duckdb / vortex-file-compressed (1.069x ➖, 0↑ 2↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176129662 169243745 1.04
tpch_q02/duckdb:vortex-file-compressed 53424995 49922924 1.07
tpch_q03/duckdb:vortex-file-compressed 131911182 121046324 1.09
tpch_q04/duckdb:vortex-file-compressed 169270474 156533909 1.08
tpch_q05/duckdb:vortex-file-compressed 147925186 134986658 1.10
tpch_q06/duckdb:vortex-file-compressed 34975334 32008500 1.09
tpch_q07/duckdb:vortex-file-compressed 141102303 132994348 1.06
tpch_q08/duckdb:vortex-file-compressed 183203933 170189323 1.08
tpch_q09/duckdb:vortex-file-compressed 413579988 394691833 1.05
tpch_q10/duckdb:vortex-file-compressed 198856637 187808108 1.06
tpch_q11/duckdb:vortex-file-compressed 33763762 31843132 1.06
tpch_q12/duckdb:vortex-file-compressed 105154578 99946179 1.05
tpch_q13/duckdb:vortex-file-compressed 284018357 273639741 1.04
tpch_q14/duckdb:vortex-file-compressed 56662933 52288471 1.08
tpch_q15/duckdb:vortex-file-compressed 95984324 89270454 1.08
tpch_q16/duckdb:vortex-file-compressed 82147665 77615355 1.06
tpch_q17/duckdb:vortex-file-compressed 🚨 102600444 93003905 1.10
tpch_q18/duckdb:vortex-file-compressed 304032306 283068424 1.07
tpch_q19/duckdb:vortex-file-compressed 82114187 79631292 1.03
tpch_q20/duckdb:vortex-file-compressed 153956827 141968114 1.08
tpch_q21/duckdb:vortex-file-compressed 🚨 536970126 485912180 1.11
tpch_q22/duckdb:vortex-file-compressed 67479766 64465310 1.05
duckdb / vortex-compact (1.062x ➖, 0↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 243150249 228711473 1.06
tpch_q02/duckdb:vortex-compact 60107395 56459909 1.06
tpch_q03/duckdb:vortex-compact 146135436 135787607 1.08
tpch_q04/duckdb:vortex-compact 181538063 170331205 1.07
tpch_q05/duckdb:vortex-compact 🚨 181535734 164493610 1.10
tpch_q06/duckdb:vortex-compact 57336466 56082799 1.02
tpch_q07/duckdb:vortex-compact 186916537 173086848 1.08
tpch_q08/duckdb:vortex-compact 203698460 186436949 1.09
tpch_q09/duckdb:vortex-compact 447215272 424617181 1.05
tpch_q10/duckdb:vortex-compact 230431281 219889752 1.05
tpch_q11/duckdb:vortex-compact 41103135 38262393 1.07
tpch_q12/duckdb:vortex-compact 171021216 161548872 1.06
tpch_q13/duckdb:vortex-compact 343385413 321694787 1.07
tpch_q14/duckdb:vortex-compact 75896566 71248281 1.07
tpch_q15/duckdb:vortex-compact 120589851 114287766 1.06
tpch_q16/duckdb:vortex-compact 83328301 80724642 1.03
tpch_q17/duckdb:vortex-compact 114188657 106885836 1.07
tpch_q18/duckdb:vortex-compact 301889908 289137503 1.04
tpch_q19/duckdb:vortex-compact 99798002 95834292 1.04
tpch_q20/duckdb:vortex-compact 186875052 175111302 1.07
tpch_q21/duckdb:vortex-compact 547697699 516246104 1.06
tpch_q22/duckdb:vortex-compact 75472742 70957805 1.06
duckdb / parquet (1.036x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 271979101 260933440 1.04
tpch_q02/duckdb:parquet 98793055 101107867 0.98
tpch_q03/duckdb:parquet 218533168 213142951 1.03
tpch_q04/duckdb:parquet 142080693 133725696 1.06
tpch_q05/duckdb:parquet 234986811 225149920 1.04
tpch_q06/duckdb:parquet 76029846 74011821 1.03
tpch_q07/duckdb:parquet 193120640 186616298 1.03
tpch_q08/duckdb:parquet 276646875 267893827 1.03
tpch_q09/duckdb:parquet 495032844 476788414 1.04
tpch_q10/duckdb:parquet 639435347 622310038 1.03
tpch_q11/duckdb:parquet 69496143 63541062 1.09
tpch_q12/duckdb:parquet 137535058 129877036 1.06
tpch_q13/duckdb:parquet 465514227 438960463 1.06
tpch_q14/duckdb:parquet 185746221 179717847 1.03
tpch_q15/duckdb:parquet 109791112 103771692 1.06
tpch_q16/duckdb:parquet 168846343 163980991 1.03
tpch_q17/duckdb:parquet 184218045 182181710 1.01
tpch_q18/duckdb:parquet 378251006 362444939 1.04
tpch_q19/duckdb:parquet 296652674 289745083 1.02
tpch_q20/duckdb:parquet 233646683 232436721 1.01
tpch_q21/duckdb:parquet 586935032 555764696 1.06
tpch_q22/duckdb:parquet 295902050 293685539 1.01
duckdb / duckdb (1.036x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 124393941 120447711 1.03
tpch_q02/duckdb:duckdb 53383381 50226866 1.06
tpch_q03/duckdb:duckdb 110433233 104938514 1.05
tpch_q04/duckdb:duckdb 144455001 139583338 1.03
tpch_q05/duckdb:duckdb 123468088 119425483 1.03
tpch_q06/duckdb:duckdb 45707610 44965566 1.02
tpch_q07/duckdb:duckdb 93894232 90687193 1.04
tpch_q08/duckdb:duckdb 123111460 118046709 1.04
tpch_q09/duckdb:duckdb 290157933 281577133 1.03
tpch_q10/duckdb:duckdb 224762611 211568813 1.06
tpch_q11/duckdb:duckdb 19820889 19389756 1.02
tpch_q12/duckdb:duckdb 91929549 91169580 1.01
tpch_q13/duckdb:duckdb 242368667 230358365 1.05
tpch_q14/duckdb:duckdb 80365327 78240656 1.03
tpch_q15/duckdb:duckdb 85041655 81790547 1.04
tpch_q16/duckdb:duckdb 79056888 75618658 1.05
tpch_q17/duckdb:duckdb 89510791 87600963 1.02
tpch_q18/duckdb:duckdb 239222658 234128616 1.02
tpch_q19/duckdb:duckdb 127274944 124081760 1.03
tpch_q20/duckdb:duckdb 120752214 118232328 1.02
tpch_q21/duckdb:duckdb 312155214 298144374 1.05
tpch_q22/duckdb:duckdb 72908295 69623856 1.05
File Size Changes (27 files changed, +0.0% overall, 13↑ 14↓)
File Scale Format Base HEAD Change %
partsupp_1.vortex 10.0 vortex-compact 103.84 MB 105.54 MB +1.70 MB +1.6%
orders_2.vortex 10.0 vortex-file-compressed 145.23 MB 145.59 MB +373.52 KB +0.3%
part_0.vortex 10.0 vortex-file-compressed 24.67 MB 24.72 MB +52.02 KB +0.2%
lineitem_0.vortex 10.0 vortex-file-compressed 134.11 MB 134.23 MB +123.69 KB +0.1%
supplier_0.vortex 10.0 vortex-file-compressed 5.78 MB 5.78 MB +4.12 KB +0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 134.04 MB 134.12 MB +78.13 KB +0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 133.53 MB 133.60 MB +67.66 KB +0.0%
lineitem_11.vortex 10.0 vortex-file-compressed 134.41 MB 134.46 MB +47.95 KB +0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 134.10 MB 134.15 MB +45.34 KB +0.0%
part_1.vortex 10.0 vortex-compact 17.00 MB 17.00 MB +3.20 KB +0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 133.97 MB 133.99 MB +24.48 KB +0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 132.77 MB 132.78 MB +4.87 KB +0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 133.99 MB 134.00 MB +3.45 KB +0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.22 MB 134.22 MB 176 B -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 133.56 MB 133.56 MB 6.78 KB -0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.50 MB 88.49 MB 12.83 KB -0.0%
partsupp_0.vortex 10.0 vortex-file-compressed 120.33 MB 120.30 MB 23.38 KB -0.0%
lineitem_1.vortex 10.0 vortex-file-compressed 133.65 MB 133.62 MB 26.20 KB -0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.33 MB 120.27 MB 55.35 KB -0.0%
lineitem_3.vortex 10.0 vortex-file-compressed 133.48 MB 133.36 MB 123.00 KB -0.1%
customer_0.vortex 10.0 vortex-compact 74.12 MB 74.04 MB 76.73 KB -0.1%
lineitem_5.vortex 10.0 vortex-file-compressed 133.57 MB 133.41 MB 165.02 KB -0.1%
orders_1.vortex 10.0 vortex-file-compressed 145.70 MB 145.50 MB 203.13 KB -0.1%
orders_0.vortex 10.0 vortex-file-compressed 144.88 MB 144.65 MB 235.27 KB -0.2%
partsupp_0.vortex 10.0 vortex-compact 105.63 MB 105.40 MB 239.01 KB -0.2%
part_1.vortex 10.0 vortex-file-compressed 24.81 MB 24.73 MB 78.36 KB -0.3%
part_0.vortex 10.0 vortex-compact 17.11 MB 17.01 MB 103.34 KB -0.6%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.1%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (-0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+1.9%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): 0.988x ➖
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.997x ➖, 1↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2073506 1905382 1.09
clickbench_q01/datafusion:vortex-file-compressed 14860990 14370080 1.03
clickbench_q02/datafusion:vortex-file-compressed 33916906 33948553 1.00
clickbench_q03/datafusion:vortex-file-compressed 39160617 40762671 0.96
clickbench_q04/datafusion:vortex-file-compressed 277628709 293581010 0.95
clickbench_q05/datafusion:vortex-file-compressed 327127424 332331116 0.98
clickbench_q06/datafusion:vortex-file-compressed 🚀 1667497 1884931 0.88
clickbench_q07/datafusion:vortex-file-compressed 18227220 18148221 1.00
clickbench_q08/datafusion:vortex-file-compressed 357996439 350040197 1.02
clickbench_q09/datafusion:vortex-file-compressed 566028482 545786751 1.04
clickbench_q10/datafusion:vortex-file-compressed 70939329 72996596 0.97
clickbench_q11/datafusion:vortex-file-compressed 82817224 82446366 1.00
clickbench_q12/datafusion:vortex-file-compressed 288637702 281809120 1.02
clickbench_q13/datafusion:vortex-file-compressed 430664315 437221691 0.99
clickbench_q14/datafusion:vortex-file-compressed 272128018 271001227 1.00
clickbench_q15/datafusion:vortex-file-compressed 322674935 326463801 0.99
clickbench_q16/datafusion:vortex-file-compressed 668994955 690021659 0.97
clickbench_q17/datafusion:vortex-file-compressed 659530453 659237836 1.00
clickbench_q18/datafusion:vortex-file-compressed 1345897778 1345768414 1.00
clickbench_q19/datafusion:vortex-file-compressed 26960524 27121306 0.99
clickbench_q20/datafusion:vortex-file-compressed 322313113 322674833 1.00
clickbench_q21/datafusion:vortex-file-compressed 405861904 413130778 0.98
clickbench_q22/datafusion:vortex-file-compressed 504149331 497904420 1.01
clickbench_q23/datafusion:vortex-file-compressed 509900179 534351687 0.95
clickbench_q24/datafusion:vortex-file-compressed 46745680 44526771 1.05
clickbench_q25/datafusion:vortex-file-compressed 77476934 77272950 1.00
clickbench_q26/datafusion:vortex-file-compressed 44925134 44465229 1.01
clickbench_q27/datafusion:vortex-file-compressed 745143322 802630672 0.93
clickbench_q28/datafusion:vortex-file-compressed 5895203512 5849083873 1.01
clickbench_q29/datafusion:vortex-file-compressed 217846845 216491180 1.01
clickbench_q30/datafusion:vortex-file-compressed 243886564 248278505 0.98
clickbench_q31/datafusion:vortex-file-compressed 284235337 293747547 0.97
clickbench_q32/datafusion:vortex-file-compressed 1130454139 1127609826 1.00
clickbench_q33/datafusion:vortex-file-compressed 1383260117 1395524036 0.99
clickbench_q34/datafusion:vortex-file-compressed 1377386669 1390517403 0.99
clickbench_q35/datafusion:vortex-file-compressed 452582807 451011445 1.00
clickbench_q36/datafusion:vortex-file-compressed 75969366 75659656 1.00
clickbench_q37/datafusion:vortex-file-compressed 34905148 34602524 1.01
clickbench_q38/datafusion:vortex-file-compressed 20653237 22058967 0.94
clickbench_q39/datafusion:vortex-file-compressed 143713575 137984954 1.04
clickbench_q40/datafusion:vortex-file-compressed 16263450 15535596 1.05
clickbench_q41/datafusion:vortex-file-compressed 15110878 14710340 1.03
clickbench_q42/datafusion:vortex-file-compressed 17462742 17095474 1.02
datafusion / parquet (0.978x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1501397 1601283 0.94
clickbench_q01/datafusion:parquet 18879096 19555304 0.97
clickbench_q02/datafusion:parquet 46139866 48434050 0.95
clickbench_q03/datafusion:parquet 38353388 38195935 1.00
clickbench_q04/datafusion:parquet 300142902 308399739 0.97
clickbench_q05/datafusion:parquet 355092244 355455528 1.00
clickbench_q06/datafusion:parquet 1542600 1591968 0.97
clickbench_q07/datafusion:parquet 22268138 22143572 1.01
clickbench_q08/datafusion:parquet 375411610 392096159 0.96
clickbench_q09/datafusion:parquet 616419097 642813035 0.96
clickbench_q10/datafusion:parquet 107973888 110876319 0.97
clickbench_q11/datafusion:parquet 131851355 135107617 0.98
clickbench_q12/datafusion:parquet 346511549 357926027 0.97
clickbench_q13/datafusion:parquet 506675470 516813530 0.98
clickbench_q14/datafusion:parquet 344784657 351925816 0.98
clickbench_q15/datafusion:parquet 346845723 362442611 0.96
clickbench_q16/datafusion:parquet 670844434 714689048 0.94
clickbench_q17/datafusion:parquet 650437782 684000452 0.95
clickbench_q18/datafusion:parquet 1390139490 1400651496 0.99
clickbench_q19/datafusion:parquet 29328166 31116833 0.94
clickbench_q20/datafusion:parquet 614589490 609120982 1.01
clickbench_q21/datafusion:parquet 661271319 664854799 0.99
clickbench_q22/datafusion:parquet 964156580 975267883 0.99
clickbench_q23/datafusion:parquet 3718907794 3824471356 0.97
clickbench_q24/datafusion:parquet 83746573 85353883 0.98
clickbench_q25/datafusion:parquet 130581425 132141582 0.99
clickbench_q26/datafusion:parquet 85113560 87570537 0.97
clickbench_q27/datafusion:parquet 1054217919 1088808842 0.97
clickbench_q28/datafusion:parquet 6671362244 6772135098 0.99
clickbench_q29/datafusion:parquet 230831585 237038045 0.97
clickbench_q30/datafusion:parquet 327785282 328462816 1.00
clickbench_q31/datafusion:parquet 377473369 366841837 1.03
clickbench_q32/datafusion:parquet 1237697108 1326133951 0.93
clickbench_q33/datafusion:parquet 1517010754 1537464904 0.99
clickbench_q34/datafusion:parquet 1488750429 1539476394 0.97
clickbench_q35/datafusion:parquet 468683308 475942678 0.98
clickbench_q36/datafusion:parquet 146504247 147164346 1.00
clickbench_q37/datafusion:parquet 57155927 58251683 0.98
clickbench_q38/datafusion:parquet 85896986 87126200 0.99
clickbench_q39/datafusion:parquet 266972466 271839230 0.98
clickbench_q40/datafusion:parquet 30620044 30091660 1.02
clickbench_q41/datafusion:parquet 26664912 27419936 0.97
clickbench_q42/datafusion:parquet 29344878 29457391 1.00
duckdb / vortex-file-compressed (0.980x ➖, 3↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6558648 6317155 1.04
clickbench_q01/duckdb:vortex-file-compressed 10256022 10380972 0.99
clickbench_q02/duckdb:vortex-file-compressed 24403102 24287169 1.00
clickbench_q03/duckdb:vortex-file-compressed 28430914 28645497 0.99
clickbench_q04/duckdb:vortex-file-compressed 184887267 188401689 0.98
clickbench_q05/duckdb:vortex-file-compressed 173136286 178646545 0.97
clickbench_q06/duckdb:vortex-file-compressed 18983393 19360644 0.98
clickbench_q07/duckdb:vortex-file-compressed 14421432 13661318 1.06
clickbench_q08/duckdb:vortex-file-compressed 260386176 263246186 0.99
clickbench_q09/duckdb:vortex-file-compressed 339834145 341975996 0.99
clickbench_q10/duckdb:vortex-file-compressed 66994317 67388870 0.99
clickbench_q11/duckdb:vortex-file-compressed 78253946 76649235 1.02
clickbench_q12/duckdb:vortex-file-compressed 200253503 200362363 1.00
clickbench_q13/duckdb:vortex-file-compressed 407471204 407238155 1.00
clickbench_q14/duckdb:vortex-file-compressed 232146873 233591328 0.99
clickbench_q15/duckdb:vortex-file-compressed 239297140 244498770 0.98
clickbench_q16/duckdb:vortex-file-compressed 533342229 532224328 1.00
clickbench_q17/duckdb:vortex-file-compressed 426525602 420086239 1.02
clickbench_q18/duckdb:vortex-file-compressed 944646248 939324605 1.01
clickbench_q19/duckdb:vortex-file-compressed 21518396 20727670 1.04
clickbench_q20/duckdb:vortex-file-compressed 300496427 312517451 0.96
clickbench_q21/duckdb:vortex-file-compressed 402763022 391046644 1.03
clickbench_q22/duckdb:vortex-file-compressed 🚀 553695986 685738163 0.81
clickbench_q23/duckdb:vortex-file-compressed 🚀 148975702 172920101 0.86
clickbench_q24/duckdb:vortex-file-compressed 46659475 42659787 1.09
clickbench_q25/duckdb:vortex-file-compressed 74548414 70654966 1.06
clickbench_q26/duckdb:vortex-file-compressed 48495160 44312426 1.09
clickbench_q27/duckdb:vortex-file-compressed 505747600 500382606 1.01
clickbench_q28/duckdb:vortex-file-compressed 3062161483 3036422028 1.01
clickbench_q29/duckdb:vortex-file-compressed 🚀 26978123 41938983 0.64
clickbench_q30/duckdb:vortex-file-compressed 210082992 216143512 0.97
clickbench_q31/duckdb:vortex-file-compressed 308302742 310475774 0.99
clickbench_q32/duckdb:vortex-file-compressed 1099778032 1121402206 0.98
clickbench_q33/duckdb:vortex-file-compressed 1086155064 1152241151 0.94
clickbench_q34/duckdb:vortex-file-compressed 1196669564 1228692185 0.97
clickbench_q35/duckdb:vortex-file-compressed 376624650 376402198 1.00
clickbench_q36/duckdb:vortex-file-compressed 28157282 28777305 0.98
clickbench_q37/duckdb:vortex-file-compressed 19101545 20243644 0.94
clickbench_q38/duckdb:vortex-file-compressed 21184141 21783364 0.97
clickbench_q39/duckdb:vortex-file-compressed 42965956 44538251 0.96
clickbench_q40/duckdb:vortex-file-compressed 18727731 19478741 0.96
clickbench_q41/duckdb:vortex-file-compressed 18911952 17906174 1.06
clickbench_q42/duckdb:vortex-file-compressed 21248194 22723327 0.94
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23485196 23463446 1.00
clickbench_q01/duckdb:parquet 29039359 29213472 0.99
clickbench_q02/duckdb:parquet 49485532 50500023 0.98
clickbench_q03/duckdb:parquet 40474856 39645647 1.02
clickbench_q04/duckdb:parquet 201821278 204401271 0.99
clickbench_q05/duckdb:parquet 261633043 257507881 1.02
clickbench_q06/duckdb:parquet 46697817 47429415 0.98
clickbench_q07/duckdb:parquet 31363637 30950721 1.01
clickbench_q08/duckdb:parquet 269548195 272965303 0.99
clickbench_q09/duckdb:parquet 396969825 398330036 1.00
clickbench_q10/duckdb:parquet 80932994 82019579 0.99
clickbench_q11/duckdb:parquet 99566366 101777649 0.98
clickbench_q12/duckdb:parquet 278788327 276299474 1.01
clickbench_q13/duckdb:parquet 467753766 461807921 1.01
clickbench_q14/duckdb:parquet 312855388 317347347 0.99
clickbench_q15/duckdb:parquet 254319520 255020849 1.00
clickbench_q16/duckdb:parquet 594028453 596539666 1.00
clickbench_q17/duckdb:parquet 498764634 496847693 1.00
clickbench_q18/duckdb:parquet 1032206607 1042610627 0.99
clickbench_q19/duckdb:parquet 27731062 29434846 0.94
clickbench_q20/duckdb:parquet 412995601 410324475 1.01
clickbench_q21/duckdb:parquet 527598090 530538497 0.99
clickbench_q22/duckdb:parquet 916941928 916192156 1.00
clickbench_q23/duckdb:parquet 267575603 267045192 1.00
clickbench_q24/duckdb:parquet 70518618 71643034 0.98
clickbench_q25/duckdb:parquet 162866155 163210661 1.00
clickbench_q26/duckdb:parquet 56178335 54083033 1.04
clickbench_q27/duckdb:parquet 643384777 637442550 1.01
clickbench_q28/duckdb:parquet 4910133146 4895062213 1.00
clickbench_q29/duckdb:parquet 42537424 41617748 1.02
clickbench_q30/duckdb:parquet 312976215 313595775 1.00
clickbench_q31/duckdb:parquet 372529541 382412977 0.97
clickbench_q32/duckdb:parquet 1113465509 1113142912 1.00
clickbench_q33/duckdb:parquet 1096102341 1100221709 1.00
clickbench_q34/duckdb:parquet 1143176362 1144531163 1.00
clickbench_q35/duckdb:parquet 368314061 365064211 1.01
clickbench_q36/duckdb:parquet 44956270 49674863 0.91
clickbench_q37/duckdb:parquet 34829408 34703599 1.00
clickbench_q38/duckdb:parquet 35064497 35578533 0.99
clickbench_q39/duckdb:parquet 88328993 84525163 1.05
clickbench_q40/duckdb:parquet 20122608 20132215 1.00
clickbench_q41/duckdb:parquet 20937864 21014983 1.00
clickbench_q42/duckdb:parquet 22733748 22661940 1.00
duckdb / duckdb (1.003x ➖, 0↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17258168 17187146 1.00
clickbench_q01/duckdb:duckdb 34490667 34060218 1.01
clickbench_q02/duckdb:duckdb 51272156 51283486 1.00
clickbench_q03/duckdb:duckdb 55504873 55959519 0.99
clickbench_q04/duckdb:duckdb 211591832 209462794 1.01
clickbench_q05/duckdb:duckdb 282762866 280567401 1.01
clickbench_q06/duckdb:duckdb 33239434 33477901 0.99
clickbench_q07/duckdb:duckdb 34909580 35212892 0.99
clickbench_q08/duckdb:duckdb 275239938 271829631 1.01
clickbench_q09/duckdb:duckdb 389989513 393391559 0.99
clickbench_q10/duckdb:duckdb 116837125 115292360 1.01
clickbench_q11/duckdb:duckdb 126152819 125522518 1.01
clickbench_q12/duckdb:duckdb 257781714 260232951 0.99
clickbench_q13/duckdb:duckdb 444040874 439702834 1.01
clickbench_q14/duckdb:duckdb 281287299 286722570 0.98
clickbench_q15/duckdb:duckdb 238912872 240691744 0.99
clickbench_q16/duckdb:duckdb 561491701 559650881 1.00
clickbench_q17/duckdb:duckdb 467761488 474714083 0.99
clickbench_q18/duckdb:duckdb 988802767 997714852 0.99
clickbench_q19/duckdb:duckdb 34710185 35066131 0.99
clickbench_q20/duckdb:duckdb 481081436 478032191 1.01
clickbench_q21/duckdb:duckdb 472837319 477456225 0.99
clickbench_q22/duckdb:duckdb 539188784 542646907 0.99
clickbench_q23/duckdb:duckdb 246691380 251025973 0.98
clickbench_q24/duckdb:duckdb 61378848 61708035 0.99
clickbench_q25/duckdb:duckdb 149376541 149564676 1.00
clickbench_q26/duckdb:duckdb 61870125 60997415 1.01
clickbench_q27/duckdb:duckdb 559417378 549333782 1.02
clickbench_q28/duckdb:duckdb 4499391432 4464665189 1.01
clickbench_q29/duckdb:duckdb 51005834 51553641 0.99
clickbench_q30/duckdb:duckdb 274871885 277903052 0.99
clickbench_q31/duckdb:duckdb 360727344 357149045 1.01
clickbench_q32/duckdb:duckdb 1109094842 1112108547 1.00
clickbench_q33/duckdb:duckdb 1119218214 1107405694 1.01
clickbench_q34/duckdb:duckdb 1180766603 1189084745 0.99
clickbench_q35/duckdb:duckdb 296584903 301038454 0.99
clickbench_q36/duckdb:duckdb 50204327 47959583 1.05
clickbench_q37/duckdb:duckdb 28890685 28697767 1.01
clickbench_q38/duckdb:duckdb 33874594 34612474 0.98
clickbench_q39/duckdb:duckdb 🚨 88518473 79966069 1.11
clickbench_q40/duckdb:duckdb 28576993 27981908 1.02
clickbench_q41/duckdb:duckdb 26881602 27256662 0.99
clickbench_q42/duckdb:duckdb 29352180 28936828 1.01
File Size Changes (104 files changed, +0.0% overall, 57↑ 47↓)
File Scale Format Base HEAD Change %
hits_55.vortex 1.0 vortex-file-compressed 166.62 MB 169.30 MB +2.68 MB +1.6%
hits_90.vortex 1.0 vortex-compact 81.72 MB 82.52 MB +816.95 KB +1.0%
hits_69.vortex 1.0 vortex-file-compressed 122.94 MB 123.48 MB +550.37 KB +0.4%
hits_62.vortex 1.0 vortex-file-compressed 117.29 MB 117.68 MB +399.70 KB +0.3%
hits_21.vortex 1.0 vortex-compact 51.39 MB 51.53 MB +144.64 KB +0.3%
hits_25.vortex 1.0 vortex-file-compressed 113.93 MB 114.11 MB +182.06 KB +0.2%
hits_65.vortex 1.0 vortex-file-compressed 183.60 MB 183.82 MB +225.05 KB +0.1%
hits_5.vortex 1.0 vortex-file-compressed 92.90 MB 93.00 MB +104.16 KB +0.1%
hits_48.vortex 1.0 vortex-file-compressed 28.04 MB 28.06 MB +27.27 KB +0.1%
hits_75.vortex 1.0 vortex-file-compressed 63.29 MB 63.35 MB +58.30 KB +0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.61 MB 138.74 MB +127.34 KB +0.1%
hits_97.vortex 1.0 vortex-compact 68.98 MB 69.04 MB +60.21 KB +0.1%
hits_73.vortex 1.0 vortex-file-compressed 110.55 MB 110.64 MB +91.37 KB +0.1%
hits_97.vortex 1.0 vortex-file-compressed 107.01 MB 107.10 MB +84.70 KB +0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.84 MB 91.91 MB +69.90 KB +0.1%
hits_32.vortex 1.0 vortex-file-compressed 66.80 MB 66.85 MB +49.46 KB +0.1%
hits_41.vortex 1.0 vortex-file-compressed 224.19 MB 224.34 MB +158.85 KB +0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.83 MB 75.88 MB +49.84 KB +0.1%
hits_3.vortex 1.0 vortex-file-compressed 142.32 MB 142.40 MB +76.11 KB +0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.37 MB 80.41 MB +39.88 KB +0.0%
hits_71.vortex 1.0 vortex-file-compressed 102.08 MB 102.13 MB +49.44 KB +0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.93 MB 77.97 MB +36.80 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.56 MB 96.61 MB +45.09 KB +0.0%
hits_30.vortex 1.0 vortex-file-compressed 87.10 MB 87.13 MB +40.01 KB +0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.55 MB 90.59 MB +35.80 KB +0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.79 MB 100.83 MB +38.52 KB +0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.42 MB 179.49 MB +67.77 KB +0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.85 MB 89.89 MB +32.53 KB +0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.27 MB 57.29 MB +19.70 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.60 MB 73.63 MB +24.87 KB +0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.55 MB 89.58 MB +29.03 KB +0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.56 MB 184.62 MB +58.23 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.63 MB 277.72 MB +87.22 KB +0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.81 MB 59.83 MB +18.22 KB +0.0%
hits_18.vortex 1.0 vortex-file-compressed 104.82 MB 104.85 MB +31.52 KB +0.0%
hits_37.vortex 1.0 vortex-file-compressed 85.83 MB 85.85 MB +23.19 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.84 MB 117.87 MB +29.47 KB +0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.01 MB 80.03 MB +19.06 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 128.29 MB 128.32 MB +26.55 KB +0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.30 MB 69.31 MB +14.00 KB +0.0%
hits_7.vortex 1.0 vortex-file-compressed 94.01 MB 94.03 MB +18.41 KB +0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.71 MB 93.73 MB +15.55 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.94 MB 104.96 MB +17.09 KB +0.0%
hits_43.vortex 1.0 vortex-file-compressed 227.40 MB 227.44 MB +36.56 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.88 MB 146.90 MB +21.22 KB +0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.58 MB 172.61 MB +24.54 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.37 MB 118.39 MB +16.35 KB +0.0%
hits_21.vortex 1.0 vortex-file-compressed 93.99 MB 94.01 MB +12.43 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.32 MB 101.33 MB +13.40 KB +0.0%
hits_16.vortex 1.0 vortex-file-compressed 79.98 MB 79.99 MB +9.30 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.77 MB 138.78 MB +15.76 KB +0.0%
hits_91.vortex 1.0 vortex-file-compressed 97.17 MB 97.18 MB +10.74 KB +0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.81 MB 119.82 MB +10.43 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 99.22 MB 99.22 MB +6.54 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.32 MB +2.02 KB +0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.99 MB 119.99 MB +4.30 KB +0.0%
hits_67.vortex 1.0 vortex-file-compressed 184.15 MB 184.15 MB +4.53 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.73 MB 135.73 MB 976 B -0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.34 MB 90.33 MB 5.90 KB -0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.51 MB 186.49 MB 14.09 KB -0.0%
hits_20.vortex 1.0 vortex-file-compressed 63.00 MB 62.99 MB 5.03 KB -0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.17 MB 223.15 MB 19.30 KB -0.0%
hits_99.vortex 1.0 vortex-file-compressed 123.19 MB 123.18 MB 10.73 KB -0.0%
hits_56.vortex 1.0 vortex-file-compressed 123.57 MB 123.56 MB 13.05 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.29 MB 164.26 MB 24.84 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.46 MB 77.45 MB 12.39 KB -0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.31 MB 99.29 MB 16.35 KB -0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.25 MB 93.23 MB 17.03 KB -0.0%
hits_12.vortex 1.0 vortex-file-compressed 101.12 MB 101.10 MB 19.63 KB -0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.60 MB 78.58 MB 15.45 KB -0.0%
hits_26.vortex 1.0 vortex-file-compressed 110.12 MB 110.10 MB 22.30 KB -0.0%
hits_82.vortex 1.0 vortex-file-compressed 99.86 MB 99.83 MB 26.42 KB -0.0%
hits_64.vortex 1.0 vortex-file-compressed 81.30 MB 81.28 MB 24.62 KB -0.0%
hits_35.vortex 1.0 vortex-file-compressed 115.16 MB 115.12 MB 36.73 KB -0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.34 MB 122.30 MB 43.20 KB -0.0%
hits_6.vortex 1.0 vortex-file-compressed 93.29 MB 93.25 MB 36.14 KB -0.0%
hits_45.vortex 1.0 vortex-file-compressed 122.18 MB 122.13 MB 52.94 KB -0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.44 MB 221.34 MB 100.79 KB -0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.88 MB 108.83 MB 51.91 KB -0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.91 MB 101.86 MB 50.36 KB -0.0%
hits_31.vortex 1.0 vortex-file-compressed 90.07 MB 90.02 MB 48.98 KB -0.1%
hits_90.vortex 1.0 vortex-file-compressed 142.16 MB 142.08 MB 82.31 KB -0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.56 MB 68.52 MB 41.61 KB -0.1%
hits_52.vortex 1.0 vortex-file-compressed 105.36 MB 105.30 MB 71.34 KB -0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.42 MB 90.36 MB 63.17 KB -0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.67 MB 69.62 MB 48.94 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 186.92 MB 186.79 MB 133.82 KB -0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.89 MB 84.82 MB 62.41 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.39 MB 69.34 MB 52.25 KB -0.1%
hits_88.vortex 1.0 vortex-file-compressed 111.49 MB 111.40 MB 93.99 KB -0.1%
hits_17.vortex 1.0 vortex-file-compressed 87.58 MB 87.51 MB 77.66 KB -0.1%
hits_46.vortex 1.0 vortex-file-compressed 69.52 MB 69.46 MB 62.22 KB -0.1%
hits_79.vortex 1.0 vortex-file-compressed 145.23 MB 145.09 MB 145.84 KB -0.1%
hits_13.vortex 1.0 vortex-file-compressed 99.37 MB 99.27 MB 103.29 KB -0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.78 MB 168.58 MB 200.17 KB -0.1%
hits_68.vortex 1.0 vortex-file-compressed 123.22 MB 123.07 MB 154.62 KB -0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.48 MB 114.33 MB 154.38 KB -0.1%
hits_84.vortex 1.0 vortex-file-compressed 117.52 MB 117.35 MB 171.19 KB -0.1%
hits_14.vortex 1.0 vortex-file-compressed 111.54 MB 111.35 MB 199.60 KB -0.2%
hits_53.vortex 1.0 vortex-file-compressed 87.58 MB 87.42 MB 164.97 KB -0.2%
hits_15.vortex 1.0 vortex-file-compressed 89.43 MB 89.26 MB 174.58 KB -0.2%
hits_34.vortex 1.0 vortex-file-compressed 98.10 MB 97.88 MB 222.42 KB -0.2%
hits_60.vortex 1.0 vortex-file-compressed 103.63 MB 103.38 MB 257.48 KB -0.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.05 GB (+0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (-0.0%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): 0.995x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.992x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 128001147 135298886 0.95
appian_q02/datafusion:vortex-file-compressed 660271211 662429999 1.00
appian_q03/datafusion:vortex-file-compressed 362832991 368498526 0.98
appian_q04/datafusion:vortex-file-compressed 27400666638 27126933727 1.01
appian_q05/datafusion:vortex-file-compressed 260437712 262759208 0.99
appian_q06/datafusion:vortex-file-compressed 418378725 413414248 1.01
appian_q07/datafusion:vortex-file-compressed 462518870 462884863 1.00
appian_q08/datafusion:vortex-file-compressed 1855255410 1860698008 1.00
datafusion / parquet (0.992x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
appian_q01/datafusion:parquet 128179596 137388409 0.93
appian_q02/datafusion:parquet 671979253 660855433 1.02
appian_q03/datafusion:parquet 358324294 357198455 1.00
appian_q04/datafusion:parquet 27764955605 27312386476 1.02
appian_q05/datafusion:parquet 289604272 294551889 0.98
appian_q06/datafusion:parquet 431754601 435879802 0.99
appian_q07/datafusion:parquet 459644136 459376793 1.00
appian_q08/datafusion:parquet 1843369384 1851700546 1.00
duckdb / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 194582499 194716919 1.00
appian_q02/duckdb:vortex-file-compressed 616147317 610572793 1.01
appian_q03/duckdb:vortex-file-compressed 257620762 266097519 0.97
appian_q04/duckdb:vortex-file-compressed 1321034007 1318312780 1.00
appian_q05/duckdb:vortex-file-compressed 291565704 293452797 0.99
appian_q06/duckdb:vortex-file-compressed 808890716 791011949 1.02
appian_q07/duckdb:vortex-file-compressed 342111928 344422763 0.99
appian_q08/duckdb:vortex-file-compressed 1275473515 1285230817 0.99
duckdb / parquet (0.996x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
appian_q01/duckdb:parquet 202147495 202581451 1.00
appian_q02/duckdb:parquet 602077752 601794738 1.00
appian_q03/duckdb:parquet 288494355 296103950 0.97
appian_q04/duckdb:parquet 1328479602 1330544026 1.00
appian_q05/duckdb:parquet 306191926 309002370 0.99
appian_q06/duckdb:parquet 793823383 788947777 1.01
appian_q07/duckdb:parquet 363916109 363966150 1.00
appian_q08/duckdb:parquet 1269163825 1266474284 1.00
duckdb / duckdb (0.996x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 172700132 173969913 0.99
appian_q02/duckdb:duckdb 545257776 554297720 0.98
appian_q03/duckdb:duckdb 383896820 385869212 0.99
appian_q04/duckdb:duckdb 1296647404 1299243605 1.00
appian_q05/duckdb:duckdb 280508365 283989800 0.99
appian_q06/duckdb:duckdb 794005201 772405136 1.03
appian_q07/duckdb:duckdb 324887555 327395099 0.99
appian_q08/duckdb:duckdb 1217408031 1223222892 1.00
File Size Changes (3 files changed, -0.0% overall, 2↑ 1↓)
File Scale Format Base HEAD Change %
orderview.vortex 1.0 vortex-file-compressed 80.98 MB 81.07 MB +91.18 KB +0.1%
creditcardview.vortex 1.0 vortex-file-compressed 60.97 MB 60.98 MB +14.21 KB +0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.58 MB → 513.68 MB (+0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.3%
Engines: DataFusion No clear signal (+6.8%, environment too noisy confidence) · DuckDB No clear signal (-0.0%, environment too noisy confidence)
Vortex (geomean): 1.079x ➖
Parquet (geomean): 1.044x ➖
Shifts: Parquet (control) +4.4% · Median polish +1.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.045x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 314674770 260777555 1.21
tpch_q02/datafusion:vortex-file-compressed 544040185 446971486 1.22
tpch_q03/datafusion:vortex-file-compressed 529552709 438728401 1.21
tpch_q04/datafusion:vortex-file-compressed 283056684 322226793 0.88
tpch_q05/datafusion:vortex-file-compressed 523207839 635505211 0.82
tpch_q06/datafusion:vortex-file-compressed 340919584 372631446 0.91
tpch_q07/datafusion:vortex-file-compressed 523556192 564022763 0.93
tpch_q08/datafusion:vortex-file-compressed 687346724 694527951 0.99
tpch_q09/datafusion:vortex-file-compressed 579873768 512226930 1.13
tpch_q10/datafusion:vortex-file-compressed 726365348 603442860 1.20
tpch_q11/datafusion:vortex-file-compressed 370522956 341420643 1.09
tpch_q12/datafusion:vortex-file-compressed 584702776 574587637 1.02
tpch_q13/datafusion:vortex-file-compressed 234536730 214148653 1.10
tpch_q14/datafusion:vortex-file-compressed 392025586 321585454 1.22
tpch_q15/datafusion:vortex-file-compressed 580576602 574779428 1.01
tpch_q16/datafusion:vortex-file-compressed 256847141 293727099 0.87
tpch_q17/datafusion:vortex-file-compressed 452367464 386865042 1.17
tpch_q18/datafusion:vortex-file-compressed 398777246 348744318 1.14
tpch_q19/datafusion:vortex-file-compressed 642312341 518174617 1.24
tpch_q20/datafusion:vortex-file-compressed 491055408 435643942 1.13
tpch_q21/datafusion:vortex-file-compressed 662113773 718327606 0.92
tpch_q22/datafusion:vortex-file-compressed 187844453 236602319 0.79
datafusion / vortex-compact (1.205x ➖, 0↑ 10↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 276068463 371923961 0.74
tpch_q02/datafusion:vortex-compact 539654934 491839322 1.10
tpch_q03/datafusion:vortex-compact 🚨 616901502 401899064 1.53
tpch_q04/datafusion:vortex-compact 🚨 317564538 238830403 1.33
tpch_q05/datafusion:vortex-compact 🚨 623345392 428726816 1.45
tpch_q06/datafusion:vortex-compact 376042631 307203351 1.22
tpch_q07/datafusion:vortex-compact 540700725 596906208 0.91
tpch_q08/datafusion:vortex-compact 688831855 751229132 0.92
tpch_q09/datafusion:vortex-compact 495476462 483238575 1.03
tpch_q10/datafusion:vortex-compact 465938832 503484334 0.93
tpch_q11/datafusion:vortex-compact 🚨 365438646 265136391 1.38
tpch_q12/datafusion:vortex-compact 🚨 808310260 391232696 2.07
tpch_q13/datafusion:vortex-compact 202393263 185523351 1.09
tpch_q14/datafusion:vortex-compact 🚨 480112730 272463075 1.76
tpch_q15/datafusion:vortex-compact 🚨 719627574 495217963 1.45
tpch_q16/datafusion:vortex-compact 🚨 371437450 201774588 1.84
tpch_q17/datafusion:vortex-compact 589739873 584152455 1.01
tpch_q18/datafusion:vortex-compact 394913734 474516508 0.83
tpch_q19/datafusion:vortex-compact 734139380 661890010 1.11
tpch_q20/datafusion:vortex-compact 569646738 628945508 0.91
tpch_q21/datafusion:vortex-compact 🚨 810150021 525528245 1.54
tpch_q22/datafusion:vortex-compact 🚨 154649520 112682746 1.37
datafusion / parquet (1.051x ➖, 0↑ 2↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 241554155 233701281 1.03
tpch_q02/datafusion:parquet 399160112 489769010 0.81
tpch_q03/datafusion:parquet 407678447 368515622 1.11
tpch_q04/datafusion:parquet 205611868 188729776 1.09
tpch_q05/datafusion:parquet 602005272 485437760 1.24
tpch_q06/datafusion:parquet 156632804 171905771 0.91
tpch_q07/datafusion:parquet 477021598 457253314 1.04
tpch_q08/datafusion:parquet 562214402 607165483 0.93
tpch_q09/datafusion:parquet 469573996 475091429 0.99
tpch_q10/datafusion:parquet 518544180 514825991 1.01
tpch_q11/datafusion:parquet 352749896 345156216 1.02
tpch_q12/datafusion:parquet 270355919 235818969 1.15
tpch_q13/datafusion:parquet 445882158 475561832 0.94
tpch_q14/datafusion:parquet 287533494 222996781 1.29
tpch_q15/datafusion:parquet 🚨 474091610 317692682 1.49
tpch_q16/datafusion:parquet 🚨 290639926 184363434 1.58
tpch_q17/datafusion:parquet 486465972 530777005 0.92
tpch_q18/datafusion:parquet 508743060 539030929 0.94
tpch_q19/datafusion:parquet 356712276 383451783 0.93
tpch_q20/datafusion:parquet 345474504 388713605 0.89
tpch_q21/datafusion:parquet 585035667 618389232 0.95
tpch_q22/datafusion:parquet 155217746 129684224 1.20
duckdb / vortex-file-compressed (1.075x ➖, 0↑ 2↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 307476567 258463460 1.19
tpch_q02/duckdb:vortex-file-compressed 1038505282 1035225706 1.00
tpch_q03/duckdb:vortex-file-compressed 710125281 689094283 1.03
tpch_q04/duckdb:vortex-file-compressed 🚨 570070352 411135541 1.39
tpch_q05/duckdb:vortex-file-compressed 856251050 980767510 0.87
tpch_q06/duckdb:vortex-file-compressed 416813003 358364442 1.16
tpch_q07/duckdb:vortex-file-compressed 947795740 956005999 0.99
tpch_q08/duckdb:vortex-file-compressed 1009147088 986264738 1.02
tpch_q09/duckdb:vortex-file-compressed 1084591356 911391400 1.19
tpch_q10/duckdb:vortex-file-compressed 754470620 764902047 0.99
tpch_q11/duckdb:vortex-file-compressed 485744533 510152675 0.95
tpch_q12/duckdb:vortex-file-compressed 694354604 685113630 1.01
tpch_q13/duckdb:vortex-file-compressed 477481882 486661731 0.98
tpch_q14/duckdb:vortex-file-compressed 449541170 415986174 1.08
tpch_q15/duckdb:vortex-file-compressed 283031039 282045559 1.00
tpch_q16/duckdb:vortex-file-compressed 343663250 364500972 0.94
tpch_q17/duckdb:vortex-file-compressed 🚨 913717262 662250718 1.38
tpch_q18/duckdb:vortex-file-compressed 640687025 538935373 1.19
tpch_q19/duckdb:vortex-file-compressed 514430022 470831760 1.09
tpch_q20/duckdb:vortex-file-compressed 873560876 753385373 1.16
tpch_q21/duckdb:vortex-file-compressed 1237875593 1014086431 1.22
tpch_q22/duckdb:vortex-file-compressed 292842591 303321832 0.97
duckdb / vortex-compact (1.000x ➖, 0↑ 2↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 279358414 290750767 0.96
tpch_q02/duckdb:vortex-compact 945813265 896473286 1.06
tpch_q03/duckdb:vortex-compact 667465916 669510513 1.00
tpch_q04/duckdb:vortex-compact 470600869 426373824 1.10
tpch_q05/duckdb:vortex-compact 781752963 781676926 1.00
tpch_q06/duckdb:vortex-compact 408947892 430332632 0.95
tpch_q07/duckdb:vortex-compact 932423100 910736687 1.02
tpch_q08/duckdb:vortex-compact 1067036850 1141095962 0.94
tpch_q09/duckdb:vortex-compact 1047226564 985930569 1.06
tpch_q10/duckdb:vortex-compact 686212953 748588568 0.92
tpch_q11/duckdb:vortex-compact 505457628 582590918 0.87
tpch_q12/duckdb:vortex-compact 591238489 707310922 0.84
tpch_q13/duckdb:vortex-compact 🚨 514567576 369478061 1.39
tpch_q14/duckdb:vortex-compact 368507613 478722350 0.77
tpch_q15/duckdb:vortex-compact 🚨 403358013 290659256 1.39
tpch_q16/duckdb:vortex-compact 343778579 328474325 1.05
tpch_q17/duckdb:vortex-compact 661056702 653535706 1.01
tpch_q18/duckdb:vortex-compact 577073867 522662120 1.10
tpch_q19/duckdb:vortex-compact 451562649 514117590 0.88
tpch_q20/duckdb:vortex-compact 820272563 867018835 0.95
tpch_q21/duckdb:vortex-compact 1022523146 985845783 1.04
tpch_q22/duckdb:vortex-compact 272685473 291292674 0.94
duckdb / parquet (1.037x ➖, 0↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 500439973 514913552 0.97
tpch_q02/duckdb:parquet 1127043589 1134807480 0.99
tpch_q03/duckdb:parquet 1004579817 910819088 1.10
tpch_q04/duckdb:parquet 650188773 759630282 0.86
tpch_q05/duckdb:parquet 1295728266 1264659450 1.02
tpch_q06/duckdb:parquet 473876579 471919291 1.00
tpch_q07/duckdb:parquet 1287131818 1300447177 0.99
tpch_q08/duckdb:parquet 1761531789 1598120619 1.10
tpch_q09/duckdb:parquet 1557182652 1611382986 0.97
tpch_q10/duckdb:parquet 1590423071 1259779138 1.26
tpch_q11/duckdb:parquet 792402313 762435861 1.04
tpch_q12/duckdb:parquet 817708802 669649082 1.22
tpch_q13/duckdb:parquet 894097832 903107486 0.99
tpch_q14/duckdb:parquet 705318642 673530883 1.05
tpch_q15/duckdb:parquet 619160247 495585143 1.25
tpch_q16/duckdb:parquet 621878563 723454409 0.86
tpch_q17/duckdb:parquet 804241834 857094279 0.94
tpch_q18/duckdb:parquet 839270746 915544840 0.92
tpch_q19/duckdb:parquet 805880560 775392183 1.04
tpch_q20/duckdb:parquet 1167427558 1261640492 0.93
tpch_q21/duckdb:parquet 1253638401 1068364416 1.17
tpch_q22/duckdb:parquet 🚨 687865269 527429960 1.30

robert3005
robert3005 reviewed Jun 4, 2026
View reviewed changes
Comment thread encodings/fastlanes/src/bitpacking/compute/compare_fused.rs
let mut words: BufferMut<u64> = BufferMut::zeroed(num_chunks * WORDS_PER_CHUNK);

let chunks = array.unpacked_chunks::<T>()?;
{
Copy link
Copy Markdown
Contributor

@robert3005 robert3005 Jun 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this a block?

robert3005
robert3005 reviewed Jun 4, 2026
View reviewed changes
Comment thread encodings/fastlanes/src/bitpacking/compute/compare_fused.rs Outdated
/// new value. Avoids a data-dependent branch per patch in the patch-fixup loop, and touches the
/// target word through a single bounds-checked `&mut`.
#[inline]
fn set_bit(words: &mut [u64], idx: usize, value: bool) {
Copy link
Copy Markdown
Contributor

@robert3005 robert3005 Jun 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should have set bit already?

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: Compression

Vortex (geomean): 0.986x ➖
Parquet (geomean): 0.968x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.958x ➖, 24↑ 2↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
compress time/Arade 1125460419 1210572247 0.93
compress time/Bimbo 5711234978 6224487611 0.92
compress time/CMSprovider 2776260047 2931585174 0.95
compress time/Euro2016 487000378 501256847 0.97
compress time/Food 🚀 355844708 395449396 0.90
compress time/HashTags 855007550 925142967 0.92
compress time/TPC-H l_comment canonical 1235236364 1291878866 0.96
compress time/TPC-H l_comment chunked 1275204736 1327242865 0.96
compress time/taxi 682859796 726434293 0.94
compress time/wide table cols=100 chunks=1 rows=1000 🚀 11695896 13071117 0.89
compress time/wide table cols=100 chunks=50 rows=1000 12311237 12840094 0.96
compress time/wide table cols=1000 chunks=1 rows=1000 128000265 140868088 0.91
compress time/wide table cols=1000 chunks=50 rows=1000 132518589 140858828 0.94
compress time/wide table cols=10000 chunks=1 rows=1000 1502853803 1572451263 0.96
compress time/wide table cols=10000 chunks=50 rows=1000 1518445991 1591747061 0.95
decompress time/Arade 🚀 26339820 31180299 0.84
decompress time/Bimbo 🚀 79867504 94468497 0.85
decompress time/CMSprovider 🚀 80645139 99078266 0.81
decompress time/Euro2016 🚀 19735527 23464602 0.84
decompress time/Food 🚀 8422050 9979801 0.84
decompress time/HashTags 90957707 97020964 0.94
decompress time/TPC-H l_comment canonical 39931997 43791926 0.91
decompress time/TPC-H l_comment chunked 🚀 40630635 47166157 0.86
decompress time/taxi 🚀 15312772 19033582 0.80
decompress time/wide table cols=100 chunks=1 rows=1000 2534833 2699173 0.94
decompress time/wide table cols=100 chunks=50 rows=1000 2714386 2732064 0.99
decompress time/wide table cols=1000 chunks=1 rows=1000 23151968 25327254 0.91
decompress time/wide table cols=1000 chunks=50 rows=1000 22927335 24854675 0.92
decompress time/wide table cols=10000 chunks=1 rows=1000 🚀 251515587 287467264 0.87
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 247400952 292457327 0.85
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2680249231 2825271216 0.95
parquet_rs-zstd compress time/Bimbo 12815643419 13582630954 0.94
parquet_rs-zstd compress time/CMSprovider 7316475965 7882173367 0.93
parquet_rs-zstd compress time/Euro2016 1360698984 1453898906 0.94
parquet_rs-zstd compress time/Food 823636614 846794467 0.97
parquet_rs-zstd compress time/HashTags 2310608548 2528356835 0.91
parquet_rs-zstd compress time/TPC-H l_comment canonical 3351961916 3520180460 0.95
parquet_rs-zstd compress time/TPC-H l_comment chunked 3306149170 3488435791 0.95
parquet_rs-zstd compress time/taxi 1229451167 1284411723 0.96
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6654448 7984506 0.83
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6426438 7807270 0.82
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 79468773 82638635 0.96
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 78522234 82140521 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 786898601 867883662 0.91
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 🚀 777476685 866541878 0.90
parquet_rs-zstd decompress time/Arade 634969166 654061548 0.97
parquet_rs-zstd decompress time/Bimbo 1728422394 1771940945 0.98
parquet_rs-zstd decompress time/CMSprovider 1782875763 1901990394 0.94
parquet_rs-zstd decompress time/Euro2016 384465319 406962171 0.94
parquet_rs-zstd decompress time/Food 204229156 212892498 0.96
parquet_rs-zstd decompress time/HashTags 708598031 775684296 0.91
parquet_rs-zstd decompress time/TPC-H l_comment canonical 615963227 633225691 0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked 617331408 630131415 0.98
parquet_rs-zstd decompress time/taxi 249687713 255004924 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2825453 3249059 0.87
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2851132 3280318 0.87
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 34003944 35562341 0.96
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 34326036 37242153 0.92
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 352292748 367293813 0.96
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 351621074 373280468 0.94
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417905212 417904828 1.00
vortex-file-compressed size/Euro2016 158440692 158807468 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185411988 184479548 1.01
vortex-file-compressed size/TPC-H l_comment canonical 178418608 178631024 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178359464 178512248 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.98
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio compress time/Food 0 0 0.93
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.00
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio compress time/taxi 0 0 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 1.07
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨 1 1 1.16
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.94
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.05
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/Bimbo 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/CMSprovider 🚀 0 0 0.87
vortex:parquet-zstd ratio decompress time/Euro2016 🚀 0 0 0.89
vortex:parquet-zstd ratio decompress time/Food 🚀 0 0 0.88
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.94
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚀 0 0 0.88
vortex:parquet-zstd ratio decompress time/taxi 🚀 0 0 0.82
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 0 0 0.90
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.01
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@robert3005 robert3005 disabled auto-merge June 4, 2026 15:51
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jun 4, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.5%
Engines: DataFusion No clear signal (-12.8%, environment too noisy confidence) · DuckDB No clear signal (+0.4%, environment too noisy confidence)
Vortex (geomean): 0.981x ➖
Parquet (geomean): 1.049x ➖
Shifts: Parquet (control) +4.9% · Median polish -4.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.143x ➖, 0↑ 5↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 863561771 661634690 1.31
tpch_q02/datafusion:vortex-file-compressed 🚨 1142993094 742906365 1.54
tpch_q03/datafusion:vortex-file-compressed 1244934744 1331018627 0.94
tpch_q04/datafusion:vortex-file-compressed 687988551 620526305 1.11
tpch_q05/datafusion:vortex-file-compressed 1101308594 1042576290 1.06
tpch_q06/datafusion:vortex-file-compressed 666601904 678475093 0.98
tpch_q07/datafusion:vortex-file-compressed 1173533452 1092150417 1.07
tpch_q08/datafusion:vortex-file-compressed 1445271817 1329107398 1.09
tpch_q09/datafusion:vortex-file-compressed 1557899936 1608919796 0.97
tpch_q10/datafusion:vortex-file-compressed 1162589407 1250984281 0.93
tpch_q11/datafusion:vortex-file-compressed 617730396 609038152 1.01
tpch_q12/datafusion:vortex-file-compressed 1394389709 1370278139 1.02
tpch_q13/datafusion:vortex-file-compressed 🚨 707789659 527434716 1.34
tpch_q14/datafusion:vortex-file-compressed 749890554 578287213 1.30
tpch_q15/datafusion:vortex-file-compressed 1102495053 1171390243 0.94
tpch_q16/datafusion:vortex-file-compressed 471202215 421498883 1.12
tpch_q17/datafusion:vortex-file-compressed 1558276674 1242900003 1.25
tpch_q18/datafusion:vortex-file-compressed 1393769264 1276023476 1.09
tpch_q19/datafusion:vortex-file-compressed 1088666828 880019056 1.24
tpch_q20/datafusion:vortex-file-compressed 927054181 879250454 1.05
tpch_q21/datafusion:vortex-file-compressed 🚨 2270862398 1600464724 1.42
tpch_q22/datafusion:vortex-file-compressed 🚨 699153986 404447065 1.73
datafusion / vortex-compact (0.902x ➖, 1↑ 1↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 697342100 702581755 0.99
tpch_q02/datafusion:vortex-compact 🚨 1114721455 790351302 1.41
tpch_q03/datafusion:vortex-compact 802312957 751089234 1.07
tpch_q04/datafusion:vortex-compact 555415443 528921638 1.05
tpch_q05/datafusion:vortex-compact 943999669 982253515 0.96
tpch_q06/datafusion:vortex-compact 593055824 781883763 0.76
tpch_q07/datafusion:vortex-compact 🚀 1041430004 2341767239 0.44
tpch_q08/datafusion:vortex-compact 1354819577 1285657850 1.05
tpch_q09/datafusion:vortex-compact 1386219987 1356607607 1.02
tpch_q10/datafusion:vortex-compact 1111356368 1235262175 0.90
tpch_q11/datafusion:vortex-compact 583789973 828097569 0.70
tpch_q12/datafusion:vortex-compact 967596355 1292860516 0.75
tpch_q13/datafusion:vortex-compact 459877247 635167380 0.72
tpch_q14/datafusion:vortex-compact 685499270 822687816 0.83
tpch_q15/datafusion:vortex-compact 964072530 985321821 0.98
tpch_q16/datafusion:vortex-compact 415220998 506138769 0.82
tpch_q17/datafusion:vortex-compact 1209956929 1253021039 0.97
tpch_q18/datafusion:vortex-compact 1232108415 1318695722 0.93
tpch_q19/datafusion:vortex-compact 905446710 1080914075 0.84
tpch_q20/datafusion:vortex-compact 1279607252 1046710304 1.22
tpch_q21/datafusion:vortex-compact 1628084622 1814654661 0.90
tpch_q22/datafusion:vortex-compact 708501118 713062093 0.99
datafusion / parquet (1.165x ➖, 0↑ 4↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 819345273 836977697 0.98
tpch_q02/datafusion:parquet 843650584 738531151 1.14
tpch_q03/datafusion:parquet 944383691 1011154528 0.93
tpch_q04/datafusion:parquet 519637567 508679977 1.02
tpch_q05/datafusion:parquet 1127601168 1088276653 1.04
tpch_q06/datafusion:parquet 545805717 536947030 1.02
tpch_q07/datafusion:parquet 1383465785 1239164893 1.12
tpch_q08/datafusion:parquet 1783973296 1564495302 1.14
tpch_q09/datafusion:parquet 2061865177 1845520920 1.12
tpch_q10/datafusion:parquet 🚨 2953258919 2140226729 1.38
tpch_q11/datafusion:parquet 🚨 987931273 653332872 1.51
tpch_q12/datafusion:parquet 897330838 742854172 1.21
tpch_q13/datafusion:parquet 959259340 1038162732 0.92
tpch_q14/datafusion:parquet 1046431348 816712709 1.28
tpch_q15/datafusion:parquet 1707491585 1342567198 1.27
tpch_q16/datafusion:parquet 🚨 776760916 408956831 1.90
tpch_q17/datafusion:parquet 1613666045 1471117544 1.10
tpch_q18/datafusion:parquet 1635400954 1727827331 0.95
tpch_q19/datafusion:parquet 1134192604 903229750 1.26
tpch_q20/datafusion:parquet 🚨 1868581930 1195102457 1.56
tpch_q21/datafusion:parquet 2079272264 1855971158 1.12
tpch_q22/datafusion:parquet 918586545 840258450 1.09
duckdb / vortex-file-compressed (0.970x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 619263179 666591362 0.93
tpch_q02/duckdb:vortex-file-compressed 1297057500 1325733478 0.98
tpch_q03/duckdb:vortex-file-compressed 1022163010 971344003 1.05
tpch_q04/duckdb:vortex-file-compressed 752286136 979369230 0.77
tpch_q05/duckdb:vortex-file-compressed 1313279311 1305074077 1.01
tpch_q06/duckdb:vortex-file-compressed 636290628 666576020 0.95
tpch_q07/duckdb:vortex-file-compressed 1372478107 1427476393 0.96
tpch_q08/duckdb:vortex-file-compressed 1486445359 1646216457 0.90
tpch_q09/duckdb:vortex-file-compressed 1785526528 1816063471 0.98
tpch_q10/duckdb:vortex-file-compressed 1472820418 1273845720 1.16
tpch_q11/duckdb:vortex-file-compressed 689108560 750859791 0.92
tpch_q12/duckdb:vortex-file-compressed 1351227743 1307943677 1.03
tpch_q13/duckdb:vortex-file-compressed 929655517 985229556 0.94
tpch_q14/duckdb:vortex-file-compressed 835483197 703855378 1.19
tpch_q15/duckdb:vortex-file-compressed 571592611 558374668 1.02
tpch_q16/duckdb:vortex-file-compressed 632118884 725722864 0.87
tpch_q17/duckdb:vortex-file-compressed 1147615064 1146320936 1.00
tpch_q18/duckdb:vortex-file-compressed 1031682261 1067047549 0.97
tpch_q19/duckdb:vortex-file-compressed 882052585 878852023 1.00
tpch_q20/duckdb:vortex-file-compressed 1336611273 1464551523 0.91
tpch_q21/duckdb:vortex-file-compressed 2036597246 2255404613 0.90
tpch_q22/duckdb:vortex-file-compressed 522381594 539659979 0.97
duckdb / vortex-compact (0.927x ➖, 1↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 612579624 605378457 1.01
tpch_q02/duckdb:vortex-compact 1275306191 1294732537 0.98
tpch_q03/duckdb:vortex-compact 908496679 991669652 0.92
tpch_q04/duckdb:vortex-compact 570323977 671097737 0.85
tpch_q05/duckdb:vortex-compact 1135546637 1479974705 0.77
tpch_q06/duckdb:vortex-compact 621213957 606435436 1.02
tpch_q07/duckdb:vortex-compact 1181102661 1381782476 0.85
tpch_q08/duckdb:vortex-compact 1477505850 1588479335 0.93
tpch_q09/duckdb:vortex-compact 1686039106 1861738070 0.91
tpch_q10/duckdb:vortex-compact 1276396901 1348901417 0.95
tpch_q11/duckdb:vortex-compact 702351407 873726748 0.80
tpch_q12/duckdb:vortex-compact 1197708785 1258408876 0.95
tpch_q13/duckdb:vortex-compact 953606100 924387407 1.03
tpch_q14/duckdb:vortex-compact 679380607 770415961 0.88
tpch_q15/duckdb:vortex-compact 613351898 594304955 1.03
tpch_q16/duckdb:vortex-compact 495357302 458039791 1.08
tpch_q17/duckdb:vortex-compact 974940122 1006588033 0.97
tpch_q18/duckdb:vortex-compact 908039371 960528057 0.95
tpch_q19/duckdb:vortex-compact 815142183 798351177 1.02
tpch_q20/duckdb:vortex-compact 1418769840 1362934371 1.04
tpch_q21/duckdb:vortex-compact 1727869893 1977235194 0.87
tpch_q22/duckdb:vortex-compact 🚀 412278841 593708711 0.69
duckdb / parquet (0.945x ➖, 0↑ 0↓)
name PR 4d50ff1 (ns) base 340d7be (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 985588594 1312627571 0.75
tpch_q02/duckdb:parquet 1515108770 1492176909 1.02
tpch_q03/duckdb:parquet 2156283809 1835294093 1.17
tpch_q04/duckdb:parquet 1219864239 1088048938 1.12
tpch_q05/duckdb:parquet 2077268814 2420790927 0.86
tpch_q06/duckdb:parquet 966675720 820241155 1.18
tpch_q07/duckdb:parquet 1909593620 2221223498 0.86
tpch_q08/duckdb:parquet 2813586249 2720693426 1.03
tpch_q09/duckdb:parquet 2818019147 2713890432 1.04
tpch_q10/duckdb:parquet 3328490597 3507739529 0.95
tpch_q11/duckdb:parquet 927700791 969001658 0.96
tpch_q12/duckdb:parquet 1303885876 1425157251 0.91
tpch_q13/duckdb:parquet 1197067601 1492911183 0.80
tpch_q14/duckdb:parquet 1373555324 1543481170 0.89
tpch_q15/duckdb:parquet 905748127 1199396339 0.76
tpch_q16/duckdb:parquet 1034574859 1151841331 0.90
tpch_q17/duckdb:parquet 1469402154 1406759020 1.04
tpch_q18/duckdb:parquet 1724973095 1776725583 0.97
tpch_q19/duckdb:parquet 1647570122 1744781026 0.94
tpch_q20/duckdb:parquet 2124581350 2430264499 0.87
tpch_q21/duckdb:parquet 1987151986 1994186976 1.00
tpch_q22/duckdb:parquet 1081478659 1192839740 0.91

@joseph-isaacs
wip
c117649 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
wip
10e904c 
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs enabled auto-merge (squash) June 4, 2026 16:07
@joseph-isaacs
Fix sliced_with_patches compare test to obtain a BitPacked via SliceK…
c495055 
…ernel

ArrayRef::slice on a patched BitPackedArray leaves a lazy SliceArray
(the buffer-free SliceReduce path bails when patches are present), so
as_::<BitPacked>() panicked before the fused compare kernel ran. Acquire
the sliced BitPacked through SliceKernel, which reads the buffers and
produces a sliced BitPacked with sliced patches, so the test exercises
the fused unpack_cmp + patch-fixup path it was written for.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
Import SliceKernel instead of absolute path to satisfy clippy::absolu…
bd3fbaa 
…te-paths

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@joseph-isaacs @robert3005 @claude